-- Logs begin at Tue 2022-08-30 04:35:15 UTC, end at Tue 2022-08-30 05:33:25 UTC. -- Aug 30 05:03:40.896585 dv-cinder-853910-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 05:03:40.905220 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 05:03:40.907222 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 05:03:40 2022] *** Aug 30 05:03:40.907222 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 05:03:40.907222 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 05:03:40.907222 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: nodename: dv-cinder-853910-4-iscsi Aug 30 05:03:40.907222 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: machine: x86_64 Aug 30 05:03:40.907222 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: clock source: unix Aug 30 05:03:40.907222 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: pcre jit disabled Aug 30 05:03:40.907222 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: detected number of CPU cores: 4 Aug 30 05:03:40.907222 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: current working directory: / Aug 30 05:03:40.907222 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: detected binary path: /usr/bin/uwsgi-core Aug 30 05:03:40.907912 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: your processes number limit is 47680 Aug 30 05:03:40.907912 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: your memory page size is 4096 bytes Aug 30 05:03:40.907912 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: detected max file descriptor number: 2048 Aug 30 05:03:40.907912 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: lock engine: pthread robust mutexes Aug 30 05:03:40.907912 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: thunder lock: enabled Aug 30 05:03:40.907912 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 05:03:40.907912 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 05:03:40.945912 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: Python main interpreter initialized at 0x5651834d49c0 Aug 30 05:03:40.945912 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: python threads support enabled Aug 30 05:03:40.945912 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: your server socket listen backlog is limited to 100 connections Aug 30 05:03:40.945912 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: your mercy for graceful operations on workers is 90 seconds Aug 30 05:03:40.946293 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 05:03:40.946293 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: *** Operational MODE: preforking *** Aug 30 05:03:40.946557 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: *** uWSGI is running in multiple interpreter mode *** Aug 30 05:03:40.946557 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: spawned uWSGI master process (pid: 105596) Aug 30 05:03:40.946727 dv-cinder-853910-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 05:03:40.947264 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: spawned uWSGI worker 1 (pid: 105597, cores: 1) Aug 30 05:03:40.947594 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: spawned uWSGI worker 2 (pid: 105598, cores: 1) Aug 30 05:03:40.947798 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 05:03:41.598611 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 05:03:41.604188 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 05:03:42.667332 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 05:03:42.667332 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: from cryptography.utils import int_from_bytes Aug 30 05:03:42.667942 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 05:03:42.667942 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: from cryptography.utils import int_from_bytes Aug 30 05:03:42.668895 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 05:03:42.668895 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: from cryptography.utils import int_from_bytes Aug 30 05:03:42.669314 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 05:03:42.669314 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: from cryptography.utils import int_from_bytes Aug 30 05:03:45.143594 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 05:03:45.144193 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 05:03:45.144380 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 05:03:45.144731 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 05:03:45.144984 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 05:03:45.145364 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.145593 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 05:03:45.145963 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.146054 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 05:03:45.146134 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.146294 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.146390 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 05:03:45.146624 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.146713 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 05:03:45.146953 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.147046 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 05:03:45.147271 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.147373 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.147586 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.147678 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.147906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.147999 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.148167 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.148267 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.148478 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.148593 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.148796 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-4-iscsi {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.148888 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.149110 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.149197 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.149417 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.149527 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.149720 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.149813 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.150029 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.150116 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.150326 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.150425 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.150641 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.150726 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-4-iscsi {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.150962 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.151051 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.151305 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.151449 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.151843 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.151986 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.152095 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.152212 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.152319 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.152462 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.152576 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.152794 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.152928 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.153105 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.153292 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.153412 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.153603 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.153728 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.153910 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.154033 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.154219 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.154349 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.154552 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.154640 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.154900 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.155080 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-4-iscsi {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.155212 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.155394 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.155537 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.155706 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.155861 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.156051 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.156167 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.156409 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.156495 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.156715 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.156849 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-4-iscsi {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.157018 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.157167 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.157317 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.157482 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.157639 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.157796 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.157941 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.158205 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.158313 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.158517 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.158614 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.158838 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.158928 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.159168 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.159272 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.159490 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.159620 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.159837 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.159925 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.160170 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.160427 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.160573 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.160793 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.160937 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.161110 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.161335 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.161473 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.161644 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.161789 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.161926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.162060 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.162211 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.162360 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.162495 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.162637 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.162800 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.162915 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.163143 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.163247 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.163391 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.163479 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.163639 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.163744 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.163955 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.164052 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.164271 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.164359 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.164576 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.164671 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.164842 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.164930 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.165162 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.165249 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.165465 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.165571 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.165769 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.165856 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.166071 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.166166 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.166372 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.166457 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.166673 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.166759 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.167003 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.167109 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.167311 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.167399 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.167617 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.167705 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.167917 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.168083 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.168231 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.168326 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.168545 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.168640 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.168854 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.168948 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.169155 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.169250 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.169472 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.169590 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.169790 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.169898 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.170091 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.170179 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.170399 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.170496 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.170710 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.170796 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.171046 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.171145 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.171348 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.171434 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.171648 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.171743 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.171961 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.172055 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.172274 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.172361 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.172573 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.172659 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.172818 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.172903 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.173116 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.173225 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.173416 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.173529 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.173725 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.173813 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.174019 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.174118 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.174318 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.174411 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.174617 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.174703 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.174934 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.175039 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.175236 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.175809 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.176049 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.176196 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.176353 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.176461 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.176650 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.176742 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.176949 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.177035 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.177248 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.177350 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.177550 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.177636 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.177847 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.177941 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.178145 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.178240 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.178448 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.178534 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.178752 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.178860 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.179081 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.179169 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.179380 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.179465 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.179681 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.179799 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.179981 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.180082 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.180288 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.180422 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.180586 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.180672 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.180888 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.180976 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.181191 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.181285 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.181490 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.181575 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.181790 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.181888 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.182095 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.182180 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.182393 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.182490 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.182695 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.182783 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.183022 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.183115 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.183317 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.183402 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.183618 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.183709 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.183926 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.184018 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.184226 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.184310 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.184527 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.184621 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.184826 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.184913 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.185133 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.185219 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.185433 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.185528 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.185731 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.185818 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.186033 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.186183 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.186333 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.186429 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.186627 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.186714 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.186950 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.187058 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.187256 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.187354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.187560 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.187645 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.187858 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.187957 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.188160 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.188243 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.188477 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.188570 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.188783 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.188876 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.189090 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.189175 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.189398 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.189482 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.189717 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:03:45.189812 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.190053 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.190139 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.190379 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.190478 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.190694 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.190788 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.191590 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.191699 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.191929 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.192022 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.192263 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.192354 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.192573 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.192658 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.192883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.192981 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.193193 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.193277 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.193508 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.193608 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.193819 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.193920 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.194135 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.194220 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.194448 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.194622 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.194764 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.194903 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.195106 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.195199 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.195413 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.195499 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.195726 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.195821 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.196051 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.196136 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.196365 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.196450 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.196670 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.196771 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.196985 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.197070 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.197313 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.197406 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.197627 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.197720 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.197935 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.198019 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.198254 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.198351 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.198566 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.198659 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.198895 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.198984 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.199205 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.199303 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.199525 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.199624 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.199845 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.199937 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.200152 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.200236 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.200462 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.200548 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.200769 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.200852 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.201087 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.201172 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.201396 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.201490 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.201703 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.201788 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.202011 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.202095 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.202318 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.202411 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.202626 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.202718 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.202968 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.203069 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.203283 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.203367 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.203594 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.203678 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.203906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.204004 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.204212 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.204298 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.204527 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.204611 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.204835 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.204929 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.205141 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.205226 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.205447 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.205532 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.205750 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.205844 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.206052 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.206138 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.206355 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.206436 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.206686 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.206780 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.207009 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.207096 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.207317 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.207403 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.207626 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.207712 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.207929 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.208012 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.208231 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.208315 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.208551 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.208645 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.208858 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.208949 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.209165 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.209251 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.209472 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.209558 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.209774 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.209866 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.210082 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.210185 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.210389 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.210476 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.210690 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.210775 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.211019 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.211167 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.211329 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.211458 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.211628 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.211755 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.211933 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.212085 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.212224 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.212358 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.212531 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.212659 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.212841 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.212977 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.213146 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.213273 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.213455 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.213594 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.213760 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.213943 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.214073 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.214212 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.214371 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.214513 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.214679 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.214847 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.215008 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.215144 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.215318 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.215445 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.215640 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.215781 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.215931 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.216068 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.216247 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.216382 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.216568 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.216699 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.216880 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.217016 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.217180 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.217317 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.217486 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.217614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.217787 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.217926 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.218088 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.218292 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.218430 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.218559 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.218692 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.218841 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.218996 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.219134 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.219297 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.219426 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.219598 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.219740 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.219900 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.220036 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.220199 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.220330 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.220505 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.220641 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.220808 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.220939 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.221106 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.221233 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.221405 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.221537 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.221708 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.221845 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.222016 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.222148 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.222344 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.222482 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.222652 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.222786 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.222977 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.223108 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.223320 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.223449 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.223630 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.223770 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.223969 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.224107 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.224286 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.224424 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.224595 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.224731 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.224906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.225035 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.225216 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.225380 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.225518 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.225652 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.225826 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.225956 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.226399 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.226546 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.226717 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.226854 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.227044 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.227143 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.227365 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.227465 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.227672 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.227760 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.227988 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.228077 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.228291 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.228389 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.228609 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.228698 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.228919 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.229006 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.229243 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.229331 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.229551 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.229638 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.229867 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.229968 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.230175 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.230271 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.230488 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.230597 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.230802 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.230920 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.231123 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.231223 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.231428 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.231515 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.231734 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.231839 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.232051 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.232140 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.232357 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.232444 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.232668 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.232763 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.232973 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.233059 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.233288 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.233383 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.233592 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.233687 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.233906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.234018 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.234208 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.234308 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.234517 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.234613 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.234838 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.234928 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.235162 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.235262 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.235467 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.235565 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.235776 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.235862 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.236097 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.236185 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.236406 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.236502 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.236766 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.236866 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.237015 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.237102 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.237318 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.237406 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.237622 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.237709 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.238455 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.238549 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.238768 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.238905 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.239140 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.239228 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.239449 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.239547 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.239750 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.239837 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.240062 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.240160 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.240371 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.240458 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.240674 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.240766 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.240973 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.241061 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.241284 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.241392 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.241591 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.241678 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.241897 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.241984 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.242203 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.242304 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.242516 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.242604 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.242835 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.242926 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.243140 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.243240 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.243461 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.243549 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.243767 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.243861 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.244069 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.244165 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.244374 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.244473 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.244670 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.244760 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.244993 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.245080 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.245298 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.245385 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.245598 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.245685 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.245900 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.245987 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.246214 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.246300 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.246521 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.246616 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.246851 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.246964 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.247163 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.247260 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.247471 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.247565 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.247782 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.247892 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.248090 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.248178 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.248396 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.248492 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.248703 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.248805 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.249011 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.249098 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.249321 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.249418 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.249628 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.249714 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.249940 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.250097 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.250242 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.250339 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.250549 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.250648 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.250875 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.250968 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.251178 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.251296 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.251486 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.251578 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.251796 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.251884 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.252108 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.252355 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.252452 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.252687 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.252783 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.253001 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.253105 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.253318 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.254114 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.254260 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.254458 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.254607 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.254778 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.254960 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.255123 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.255286 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.255445 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.255599 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.255798 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.255899 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.256134 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.256224 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.256471 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.256565 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.256777 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.256863 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.257087 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.257195 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.257389 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.257477 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.257691 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.257779 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.257992 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.258080 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.258300 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.258389 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.258599 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.258701 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.258921 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.259014 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.259228 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.259316 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.259529 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.259632 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.259831 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.259929 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.260129 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.260216 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.260433 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.260534 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.260731 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.260865 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.261045 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.261138 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.261347 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.261480 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.261649 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.261736 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.261949 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.262037 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.262246 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.262346 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.262571 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.262657 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.262890 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.262978 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.263197 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.263285 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.263503 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.263591 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.263845 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.263932 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.264145 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.264231 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.264445 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.264590 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.264765 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.264852 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.265066 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.265154 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.265364 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.265452 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.265662 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.265748 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.265969 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.266058 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.266275 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.266369 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.266574 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.266676 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.266902 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.267007 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.267210 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.267310 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.267517 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.267618 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.267818 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.267905 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.268117 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.268204 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.268423 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.268519 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.268723 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.268816 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.269033 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.269134 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.269357 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.269453 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.269655 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.269749 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.269954 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.270048 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.270260 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.270349 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.270566 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.270652 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.270883 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.270985 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.271190 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.271277 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.271487 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.271618 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.271798 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.271893 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.272097 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.272187 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.272398 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.272492 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.272697 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.272783 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.273002 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.273090 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.273305 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.273391 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.273602 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.273697 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.273903 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.273991 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.274212 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.274298 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.274512 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.274609 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.274832 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.274921 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.275150 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.275236 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.275450 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.275552 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.275756 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.275844 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.276050 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.276136 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.276364 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.276460 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.276666 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.276753 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.276963 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.277048 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.277274 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.277397 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.277574 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.277673 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.277875 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.277971 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.278173 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.278269 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.278474 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.278569 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.278770 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.278909 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.279094 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.279197 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.279395 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.279495 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.279693 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.279786 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.279990 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.280092 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.280291 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.280384 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.280596 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.280699 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.280895 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.281003 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.281193 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.281286 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.281487 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.281607 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.281809 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.281909 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.282113 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.282199 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.282418 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.282512 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.282722 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.282806 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.283075 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.283160 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.283379 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.283476 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.283687 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.283779 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.283995 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.284079 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.284305 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.284393 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.284605 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.284719 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.284944 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.285037 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.285250 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.285336 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.285560 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.285645 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.285861 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.285944 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.286313 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.286413 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.286501 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.286581 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.286768 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.286872 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.287098 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.287186 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.287406 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.287497 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.287723 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.287807 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.288033 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.288118 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.288332 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.288423 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.288640 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.288734 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.288948 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.289033 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.289259 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.289344 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.289563 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.289660 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.289868 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.289958 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.290174 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.290259 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.290482 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.290585 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.290789 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.290914 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.291116 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.291211 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.291419 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.291522 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.291722 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.291836 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.292030 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.292119 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.292332 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.292420 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.292631 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.292727 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.292935 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.293021 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.293238 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.293326 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.293536 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.293623 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.293839 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.293927 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.294137 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.294244 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.294442 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.294530 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.294741 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.294862 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.295086 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.295194 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.295386 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.295474 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.295693 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.295790 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.295998 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.296086 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.296350 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.296484 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.296655 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.296752 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.296965 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.297053 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.297273 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.297361 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.297573 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.297681 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.297903 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.297993 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.298215 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.298302 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.298525 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.298622 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.298840 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.298943 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.299169 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.299255 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.299467 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.299556 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.299770 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.299857 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.300088 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.300177 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.300908 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.301008 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.301214 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.301329 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.301513 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.301608 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.301830 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.301926 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.302130 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.302232 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.302430 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.302523 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.302734 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.302870 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.303085 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.303174 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.303388 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.303489 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.303708 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.303861 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.304120 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.304215 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.304432 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.304529 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.304733 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.304867 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.305073 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.305212 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.305378 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.305492 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.305682 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.305779 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.305991 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.306078 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.306296 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.306383 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.306611 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.306708 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.306952 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.307045 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.307261 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.307348 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.307584 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.307734 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.307865 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.307952 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.308181 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.308269 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.308495 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.308584 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.308801 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.308887 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.309102 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.309189 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.309423 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.309512 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.309742 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.309830 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.310056 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.310143 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.310375 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.310464 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.310724 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.310832 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.311050 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.311224 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.311376 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.311466 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.311644 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.311746 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.311944 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.312042 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.312245 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.312333 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.312562 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.312650 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.312861 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.312957 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.313166 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.313254 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.313472 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.313566 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.313777 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.313879 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.314076 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.314164 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.314377 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.314467 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.314682 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.314777 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.315002 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.315103 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.315305 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.315393 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.315609 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.315699 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.315945 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.316032 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.316770 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.316858 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.317070 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.317165 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.317385 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.317472 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.317689 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.317821 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.317989 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.318078 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.318289 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.318376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.318587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.318674 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.318929 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.319022 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.319234 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.319320 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.319537 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.319636 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.319841 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.319936 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.320176 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.320261 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.320478 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.320577 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.320797 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.320885 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.321117 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.321228 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.321439 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.321547 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.321741 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.321827 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.322056 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.322188 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.322355 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.322452 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.322653 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.322748 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.322996 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.323097 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.323299 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.323396 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.323599 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.323687 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.323897 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.323993 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.324201 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.324327 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.324498 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.324593 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.324794 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.324881 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.325091 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.325186 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.325417 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.325543 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.325696 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.325792 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.325998 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.326085 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.326302 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.326397 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.326599 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.326694 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.326923 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.327017 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.327222 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.327310 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.327551 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.327661 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.327852 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.327946 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.328156 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.328241 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.328459 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.328556 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.328774 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.328860 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.329087 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.329174 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.329399 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.329499 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.329706 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.329793 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.330014 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.330100 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.330324 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.330412 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.330633 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.330728 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.330969 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.331075 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.331276 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.331363 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.331609 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.331709 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.331927 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.332052 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.332235 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.332327 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.332543 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.332746 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.332859 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.333073 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.333174 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.333385 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.333479 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.333697 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.333985 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.334081 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.334303 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.334387 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.334611 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.334704 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.334940 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.335048 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.335251 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.335337 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.335560 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.335659 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.335864 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.335967 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.336179 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.336272 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.336494 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.336581 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.336879 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.336977 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.337124 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.337210 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.337442 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.337526 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.337753 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.337840 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.338065 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.338163 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.338375 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.338471 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.338705 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.338790 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.339057 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.339142 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.339359 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.339459 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.339676 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.339760 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.339987 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.340081 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.340300 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.340396 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.340609 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.340702 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.340916 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.341002 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.341230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.341325 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.341539 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.341639 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.341851 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.341948 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.342155 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.342242 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.342465 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.342550 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.342778 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.342900 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.343120 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.343206 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.343434 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.343519 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.343749 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.343844 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.344060 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.344144 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.344370 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.344456 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.344691 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.344787 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.345014 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.345194 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.345332 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.345504 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.345682 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.345836 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.345970 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.346157 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.346477 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.346560 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.346789 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.346892 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.347131 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.347225 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.347478 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.347576 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.347782 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.347868 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.348088 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.348207 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.348398 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.348497 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.348705 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.348800 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.349012 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.349164 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.349302 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.349451 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.349614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.349706 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.349926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.350031 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.350228 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.350331 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.350534 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.350619 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.350875 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.351341 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.351446 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.351689 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.351776 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.352005 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.352103 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.352324 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.352576 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.352673 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.352920 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.353006 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.353235 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.353319 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.353555 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.353643 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.353860 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.353946 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.354163 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.354249 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.354476 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.354563 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.354784 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.354886 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.355111 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.355198 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.355412 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.355499 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.355722 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.355808 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.356030 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.356117 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.356331 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.356418 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.356635 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.356720 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.356935 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.357028 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.357252 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.357340 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.357554 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.357645 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.357856 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.357952 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.358174 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.358313 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.358463 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.358550 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.358762 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.358896 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.359089 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.359182 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.359390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.359474 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.359696 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.359790 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.359999 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.360084 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.360295 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.360380 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.360598 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.360683 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.360895 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.360980 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.361202 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.361288 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.361502 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.361589 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.361806 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.361892 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.362107 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.362192 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.362421 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.362508 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.362725 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.363324 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.363561 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.363645 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.363876 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.363963 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.364182 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.364275 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.364500 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.364595 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.364805 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.364890 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.365108 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.365199 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.365420 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.365518 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.365742 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.365873 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.366055 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.366264 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.366357 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.366594 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.366690 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.366939 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.367029 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.367271 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.367564 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.367663 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.367889 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.367974 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.368193 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.368278 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.368495 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.368590 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.368815 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.368902 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.369124 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.369210 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.369431 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.369526 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.369736 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.369822 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.370048 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.370132 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.370358 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.370446 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.370661 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.370757 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.370992 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.371097 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.371301 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.371395 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.371608 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.371695 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.371912 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.372007 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.372220 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.372312 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.372526 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.372610 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.372834 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.372928 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.373140 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.373225 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.373448 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.373533 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.373758 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.373845 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.374069 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.374154 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.374380 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.374467 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.374690 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.374783 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.375028 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.375115 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.375334 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.375418 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.375640 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.375727 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.375945 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.376030 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.376248 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.376333 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.376559 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.376655 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.376872 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.376957 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.377179 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.377271 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.377482 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.377575 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.377796 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.377881 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.378128 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.378224 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.378481 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.379081 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.379315 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.379414 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.379666 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.379759 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.379982 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.380067 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.380303 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.380388 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.380609 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.380696 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.380926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.381020 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.381235 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.381320 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.381556 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.381690 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.381868 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.381955 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.382190 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.382318 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.382501 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.382588 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.382799 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.382931 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.383122 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.383226 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.383424 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.383509 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.383730 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.383815 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.384044 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.384139 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.384350 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.384435 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.384648 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.384733 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.384945 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.385040 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.385250 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.385336 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.385551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.385636 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.385851 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.385945 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.386152 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.386307 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.386450 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.386535 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.386753 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.386859 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.387081 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.387167 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.387378 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.387461 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.387676 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.387763 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.387973 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.388060 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.388269 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.388363 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.388567 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.388653 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.388865 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.388950 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.389161 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.389254 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.389459 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.389544 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.389752 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.389836 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.390057 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.390155 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.390351 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.390435 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.390653 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.390737 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.390978 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.391083 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.391284 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.391372 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.391587 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.391673 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.391907 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.391999 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.392222 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.392308 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.392528 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.392622 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.392842 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.392929 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.393149 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.393241 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.393458 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.393543 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.393806 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.393908 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.394103 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.394189 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.394411 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.394495 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.394720 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.394832 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.395051 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.395147 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.395358 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.395444 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.395668 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.395762 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.395976 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.396062 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.396287 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.396388 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.396600 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.396686 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.396903 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.396987 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.397219 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.397315 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.397530 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.397615 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.397849 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.397934 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.398153 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.398246 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.398462 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.398545 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.398783 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.398899 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.399126 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.399213 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.399435 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.399528 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.399743 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.399830 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.400056 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.400143 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.400362 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.400455 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.400672 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.400756 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.400978 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.401063 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.401286 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.401378 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.401596 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.401694 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.401907 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.402000 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.402215 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.402307 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.402526 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.402621 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.402858 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.402970 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.403179 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.403275 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.403940 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.404121 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.404121 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.404338 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.404934 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.405030 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.405286 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.405398 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.405617 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.405715 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.405934 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.406033 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.406250 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.406376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.406558 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.406649 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.406800 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 05:03:45.406978 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.407300 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.407623 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.407934 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:03:45.408182 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 05:03:45.561636 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO dbcounter [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] Registered counter for database nova_api Aug 30 05:03:45.566549 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO dbcounter [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] Registered counter for database nova_api Aug 30 05:03:45.584815 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG oslo_db.sqlalchemy.engines [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 05:03:45.591504 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writer thread running {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 05:03:45.592418 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_db.sqlalchemy.engines [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 05:03:45.598754 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writer thread running {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 05:03:45.648191 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.context [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f3c89321-9723-4736-ac96-a4b564d2d0f3(cell1) {{(pid=105597) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 05:03:45.651936 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG oslo_concurrency.lockutils [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:45.652402 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG oslo_concurrency.lockutils [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:45.653947 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG oslo_concurrency.lockutils [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:45.654476 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.context [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f3c89321-9723-4736-ac96-a4b564d2d0f3(cell1) {{(pid=105598) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 05:03:45.654671 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG oslo_concurrency.lockutils [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:45.655141 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG oslo_concurrency.lockutils [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:45.657086 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG oslo_concurrency.lockutils [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:45.658265 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:45.658730 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:45.659053 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO dbcounter [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] Registered counter for database nova_cell0 Aug 30 05:03:45.660411 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:45.661125 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:45.661561 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:45.663121 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO dbcounter [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] Registered counter for database nova_cell1 Aug 30 05:03:45.663531 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:45.665453 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO dbcounter [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] Registered counter for database nova_cell0 Aug 30 05:03:45.669416 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO dbcounter [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] Registered counter for database nova_cell1 Aug 30 05:03:45.670331 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG oslo_db.sqlalchemy.engines [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 05:03:45.671953 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG oslo_db.sqlalchemy.engines [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 05:03:45.676696 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_db.sqlalchemy.engines [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 05:03:45.677430 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writer thread running {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 05:03:45.680050 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_db.sqlalchemy.engines [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 05:03:45.680232 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writer thread running {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 05:03:45.684004 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writer thread running {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 05:03:45.822161 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writer thread running {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 05:03:45.823770 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO dbcounter [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] Registered counter for database nova_cell0 Aug 30 05:03:45.832172 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO dbcounter [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] Registered counter for database nova_cell0 Aug 30 05:03:45.832328 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG oslo_db.sqlalchemy.engines [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 05:03:45.836491 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writer thread running {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 05:03:45.838798 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_db.sqlalchemy.engines [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 05:03:45.843084 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writer thread running {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 05:03:46.170396 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: WARNING keystonemiddleware.auth_token [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 05:03:46.171087 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: WARNING keystonemiddleware.auth_token [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 05:03:46.178499 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: WARNING keystonemiddleware.auth_token [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 05:03:46.178789 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: WARNING keystonemiddleware.auth_token [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 05:03:46.515642 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: WARNING keystonemiddleware.auth_token [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 05:03:46.521759 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: WARNING keystonemiddleware.auth_token [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 05:03:46.522094 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: WARNING keystonemiddleware.auth_token [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 05:03:46.527332 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5651834d49c0 pid: 105598 (default app) Aug 30 05:03:46.527694 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: WARNING keystonemiddleware.auth_token [None req-394fae5a-d38b-4cbb-99b9-141214e78b3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 05:03:46.529404 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:46.530565 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] 10.222.0.77 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001713 Aug 30 05:03:46.531001 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 1/1] 10.222.0.77 () {50 vars in 788 bytes} [Tue Aug 30 05:03:46 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:03:46.532929 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5651834d49c0 pid: 105597 (default app) Aug 30 05:05:03.507755 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:03.508739 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Aug 30 05:05:03.509137 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 2/2] 10.222.0.77 () {54 vars in 931 bytes} [Tue Aug 30 05:05:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:03.520943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writing DB stats nova_api:SELECT=3 {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:03.521879 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writing DB stats nova_cell0:SELECT=3 {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:03.523060 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writing DB stats nova_cell1:SELECT=3 {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:03.524188 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:04.395461 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-fe9ffc2f-aa3b-4c18-b912-8527d4666cc5 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:04.427777 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-fe9ffc2f-aa3b-4c18-b912-8527d4666cc5 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.911835 Aug 30 05:05:04.428684 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 1/3] 10.222.0.77 () {60 vars in 1292 bytes} [Tue Aug 30 05:05:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:06.794335 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:06.795367 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-1067ac5b-62b0-44ad-8721-e587311e529f None None] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 30 05:05:06.795948 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 3/4] 10.222.0.77 () {54 vars in 931 bytes} [Tue Aug 30 05:05:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:07.235716 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-277f20fe-3f41-487b-a855-3e551d1e80ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "disk": 1, "id": "c1"}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:07.291994 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-277f20fe-3f41-487b-a855-3e551d1e80ac admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.490159 Aug 30 05:05:07.295176 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 2/5] 10.222.0.77 () {64 vars in 1283 bytes} [Tue Aug 30 05:05:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:05:07.306451 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_api:SELECT=3 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:07.307544 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_cell0:SELECT=3 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:07.308327 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_cell1:SELECT=3 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:07.309385 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:07.517617 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-51674660-c8db-4367-a6be-5abec4d98bdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:07.584205 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-51674660-c8db-4367-a6be-5abec4d98bdd admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282805 Aug 30 05:05:07.584798 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 4/6] 10.222.0.77 () {64 vars in 1336 bytes} [Tue Aug 30 05:05:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:09.972465 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-277f20fe-3f41-487b-a855-3e551d1e80ac admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:09.973482 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-277f20fe-3f41-487b-a855-3e551d1e80ac admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 30 05:05:09.974077 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 3/7] 10.222.0.77 () {54 vars in 931 bytes} [Tue Aug 30 05:05:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:05:10.645217 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-e27d2276-4331-4d57-ab28-f0b0e6bd2831 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "vcpus": 1, "id": "d1"}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:10.684138 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-e27d2276-4331-4d57-ab28-f0b0e6bd2831 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.703342 Aug 30 05:05:10.685072 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 5/8] 10.222.0.77 () {64 vars in 1283 bytes} [Tue Aug 30 05:05:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 05:05:10.696722 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-1bf16508-e931-46d8-99b5-aafb9363dd26 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:10.737110 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-1bf16508-e931-46d8-99b5-aafb9363dd26 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043950 Aug 30 05:05:10.737722 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 4/9] 10.222.0.77 () {64 vars in 1336 bytes} [Tue Aug 30 05:05:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:13.085011 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-e27d2276-4331-4d57-ab28-f0b0e6bd2831 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:13.086070 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-e27d2276-4331-4d57-ab28-f0b0e6bd2831 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 30 05:05:13.086472 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 6/10] 10.222.0.77 () {54 vars in 931 bytes} [Tue Aug 30 05:05:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:13.495203 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-8621b985-8e62-4491-a9ea-3650343df100 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:13.513503 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-8621b985-8e62-4491-a9ea-3650343df100 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.420800 Aug 30 05:05:13.514046 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 5/11] 10.222.0.77 () {64 vars in 1283 bytes} [Tue Aug 30 05:05:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 05:05:13.526829 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-2ac1ebea-06a7-4fef-8f82-2c5528f6467b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:13.550268 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-2ac1ebea-06a7-4fef-8f82-2c5528f6467b admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027213 Aug 30 05:05:13.550844 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 7/12] 10.222.0.77 () {64 vars in 1336 bytes} [Tue Aug 30 05:05:13 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:05:15.888379 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-8621b985-8e62-4491-a9ea-3650343df100 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:15.890760 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-8621b985-8e62-4491-a9ea-3650343df100 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 30 05:05:15.890760 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 6/13] 10.222.0.77 () {54 vars in 931 bytes} [Tue Aug 30 05:05:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:16.372146 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-fa2de6e0-c11f-4391-9dc2-64558e22b343 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:16.392071 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-fa2de6e0-c11f-4391-9dc2-64558e22b343 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.494414 Aug 30 05:05:16.392628 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 8/14] 10.222.0.77 () {64 vars in 1283 bytes} [Tue Aug 30 05:05:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 05:05:16.404732 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-95cea4c6-78dd-4d1e-b025-e74678ece760 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:16.431255 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-95cea4c6-78dd-4d1e-b025-e74678ece760 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030236 Aug 30 05:05:16.431927 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 7/15] 10.222.0.77 () {64 vars in 1336 bytes} [Tue Aug 30 05:05:16 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:18.785882 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-fa2de6e0-c11f-4391-9dc2-64558e22b343 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:18.787201 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-fa2de6e0-c11f-4391-9dc2-64558e22b343 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001814 Aug 30 05:05:18.787925 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 9/16] 10.222.0.77 () {54 vars in 931 bytes} [Tue Aug 30 05:05:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:19.211642 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-dd79bc27-a54f-4a23-9364-e5b2fda4e520 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "vcpus": 4, "ram": 4096}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:19.232668 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-dd79bc27-a54f-4a23-9364-e5b2fda4e520 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.438531 Aug 30 05:05:19.233373 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 8/17] 10.222.0.77 () {64 vars in 1283 bytes} [Tue Aug 30 05:05:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:05:19.245767 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-eed0badf-2d61-4c15-8452-2f7190ba2cdb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:19.268433 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-eed0badf-2d61-4c15-8452-2f7190ba2cdb admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026264 Aug 30 05:05:19.268974 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 10/18] 10.222.0.77 () {64 vars in 1336 bytes} [Tue Aug 30 05:05:19 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:21.627187 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-dd79bc27-a54f-4a23-9364-e5b2fda4e520 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:21.628157 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-dd79bc27-a54f-4a23-9364-e5b2fda4e520 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 30 05:05:21.628558 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 9/19] 10.222.0.77 () {54 vars in 931 bytes} [Tue Aug 30 05:05:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:22.048812 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-b5d1620c-d5b3-4249-9ee1-3b6d40bd7acf admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:22.081037 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-b5d1620c-d5b3-4249-9ee1-3b6d40bd7acf admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.446311 Aug 30 05:05:22.081703 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 11/20] 10.222.0.77 () {60 vars in 1292 bytes} [Tue Aug 30 05:05:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:05:24.827330 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-dd79bc27-a54f-4a23-9364-e5b2fda4e520 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:24.828338 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-dd79bc27-a54f-4a23-9364-e5b2fda4e520 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 30 05:05:24.828736 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 10/21] 10.222.0.77 () {54 vars in 931 bytes} [Tue Aug 30 05:05:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:25.251272 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-46a99bb1-9ab2-4933-a11e-18f516cc5855 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "1", "ram": 512, "rxtx_factor": 1.0}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:25.269186 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-46a99bb1-9ab2-4933-a11e-18f516cc5855 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.434389 Aug 30 05:05:25.269736 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 12/22] 10.222.0.77 () {64 vars in 1283 bytes} [Tue Aug 30 05:05:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:05:25.281711 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-7b5a498f-be46-44c3-875f-4fa670a296d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:25.305692 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-7b5a498f-be46-44c3-875f-4fa670a296d1 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027632 Aug 30 05:05:25.306254 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 11/23] 10.222.0.77 () {64 vars in 1333 bytes} [Tue Aug 30 05:05:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:27.625990 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-46a99bb1-9ab2-4933-a11e-18f516cc5855 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:27.627059 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-46a99bb1-9ab2-4933-a11e-18f516cc5855 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 30 05:05:27.627455 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 13/24] 10.222.0.77 () {54 vars in 931 bytes} [Tue Aug 30 05:05:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:28.028222 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-00a1c261-a70e-4405-a39c-73232b923ec8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:28.049824 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-00a1c261-a70e-4405-a39c-73232b923ec8 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.416129 Aug 30 05:05:28.050385 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 12/25] 10.222.0.77 () {64 vars in 1283 bytes} [Tue Aug 30 05:05:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 05:05:28.062387 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-3e3e2e99-b820-481f-99b5-700aa9f94fa6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:28.086430 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-3e3e2e99-b820-481f-99b5-700aa9f94fa6 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027519 Aug 30 05:05:28.087203 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 14/26] 10.222.0.77 () {64 vars in 1333 bytes} [Tue Aug 30 05:05:28 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:30.481402 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-00a1c261-a70e-4405-a39c-73232b923ec8 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:30.482690 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-00a1c261-a70e-4405-a39c-73232b923ec8 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001730 Aug 30 05:05:30.483125 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 13/27] 10.222.0.77 () {54 vars in 931 bytes} [Tue Aug 30 05:05:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:30.956995 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-b7608d42-5c2c-445a-9f1c-b9bf13795487 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "swap": 0, "id": "3", "vcpus": 2, "disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:31.010093 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-b7608d42-5c2c-445a-9f1c-b9bf13795487 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.519883 Aug 30 05:05:31.010645 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 15/28] 10.222.0.77 () {64 vars in 1283 bytes} [Tue Aug 30 05:05:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 05:05:31.023532 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-67712507-415a-4a3c-9be4-62473fa4c6f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:31.052276 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-67712507-415a-4a3c-9be4-62473fa4c6f5 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032061 Aug 30 05:05:31.052879 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 14/29] 10.222.0.77 () {64 vars in 1333 bytes} [Tue Aug 30 05:05:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:33.391544 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-b7608d42-5c2c-445a-9f1c-b9bf13795487 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:33.392143 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-b7608d42-5c2c-445a-9f1c-b9bf13795487 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 30 05:05:33.392554 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 16/30] 10.222.0.77 () {54 vars in 931 bytes} [Tue Aug 30 05:05:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:33.842464 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-64dbd1ae-dcbd-4198-8b80-4e2421d8835f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "disk": 80}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:33.848971 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:33.864039 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-64dbd1ae-dcbd-4198-8b80-4e2421d8835f admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.465895 Aug 30 05:05:33.864828 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 15/31] 10.222.0.77 () {64 vars in 1283 bytes} [Tue Aug 30 05:05:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 05:05:33.877045 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-a56bdfc6-3937-4e32-a99c-6899476f3a73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:33.903677 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-a56bdfc6-3937-4e32-a99c-6899476f3a73 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030554 Aug 30 05:05:33.904547 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 17/32] 10.222.0.77 () {64 vars in 1333 bytes} [Tue Aug 30 05:05:33 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:05:36.250213 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-64dbd1ae-dcbd-4198-8b80-4e2421d8835f admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:36.253247 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-64dbd1ae-dcbd-4198-8b80-4e2421d8835f admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003141 Aug 30 05:05:36.254179 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 16/33] 10.222.0.77 () {54 vars in 931 bytes} [Tue Aug 30 05:05:36 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:36.756531 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-1b16814f-17ff-4ecd-9bc8-7f6e54e9d71f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160, "vcpus": 8}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:36.776603 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-1b16814f-17ff-4ecd-9bc8-7f6e54e9d71f admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.511675 Aug 30 05:05:36.777141 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 18/34] 10.222.0.77 () {64 vars in 1283 bytes} [Tue Aug 30 05:05:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:05:36.788986 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-21782df9-129e-4356-afbd-2f21b86e3519 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:36.815390 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-21782df9-129e-4356-afbd-2f21b86e3519 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029909 Aug 30 05:05:36.816256 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 17/35] 10.222.0.77 () {64 vars in 1333 bytes} [Tue Aug 30 05:05:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:05:54.960074 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-1b16814f-17ff-4ecd-9bc8-7f6e54e9d71f admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:54.961006 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-1b16814f-17ff-4ecd-9bc8-7f6e54e9d71f admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 30 05:05:54.961402 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 19/36] 10.222.0.77 () {54 vars in 931 bytes} [Tue Aug 30 05:05:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:54.971776 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:55.352804 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-761d2374-412d-4b05-8271-c066825811af admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:55.372437 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-761d2374-412d-4b05-8271-c066825811af admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405046 Aug 30 05:05:55.372975 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 18/37] 10.222.0.77 () {60 vars in 1292 bytes} [Tue Aug 30 05:05:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:05:56.418752 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-1b16814f-17ff-4ecd-9bc8-7f6e54e9d71f admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:56.419776 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-1b16814f-17ff-4ecd-9bc8-7f6e54e9d71f admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 30 05:05:56.420165 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 20/38] 10.222.0.77 () {56 vars in 1074 bytes} [Tue Aug 30 05:05:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:56.945589 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-8bb01123-bb92-4b41-9de6-062bd0d561d9 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:56.951163 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.wsgi [None req-8bb01123-bb92-4b41-9de6-062bd0d561d9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-8bb01123-bb92-4b41-9de6-062bd0d561d9 admin admin] Request method failure captured: Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Accept: application/json Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Accept-Encoding: gzip, deflate Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Connection: keep-alive Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Content-Length: 0 Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Host: 10.222.0.77 Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Openstack-Api-Version: compute 2.90 Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Openstack-System-Scope: None Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: User-Agent: python-novaclient Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Auth-Token: gAAAAABjDZq0oO35ma6Lb1gVc8OSyNEmnHPn08wdI6Rt1Z7sEinpY-6EjiaySKbARK_rqZRovv1-_M1F3fo3Dj7EE5RTOAyPO_7ZKwX4cTO_8gcVvWHpvpEi5H3I_WUx7LXRil36FwIooOrixw4IpvHA8wVRhfoSSbMw37VrAnJ9UH1tqnAnhUw Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Domain-Id: None Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Domain-Name: None Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Identity-Status: Confirmed Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Is-Admin-Project: True Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Project-Domain-Id: default Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Project-Domain-Name: Default Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Project-Id: 46478c740f59492585d5babfa714b5b5 Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Project-Name: admin Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Role: reader,member,admin Aug 30 05:05:56.954376 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Roles: reader,member,admin Aug 30 05:05:56.955806 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/46478c740f59492585d5babfa714b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/46478c740f59492585d5babfa714b5b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/46478c740f59492585d5babfa714b5b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_46478c740f59492585d5babfa714b5b5", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:05:56.955806 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Tenant: admin Aug 30 05:05:56.955806 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Tenant-Id: 46478c740f59492585d5babfa714b5b5 Aug 30 05:05:56.955806 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Tenant-Name: admin Aug 30 05:05:56.955806 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-User: admin Aug 30 05:05:56.955806 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-User-Domain-Id: default Aug 30 05:05:56.955806 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-User-Domain-Name: Default Aug 30 05:05:56.955806 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-User-Id: fdab92bac3f64739a0fcb5f729d40f85 Aug 30 05:05:56.955806 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-User-Name: admin Aug 30 05:05:56.955806 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: method: > Aug 30 05:05:56.955806 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: exception: Flavor 42 could not be found. Aug 30 05:05:56.955806 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: action_args: {'id': '42'} Aug 30 05:05:56.955806 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:05:56.955806 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:05:56.956641 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Aug 30 05:05:56.957989 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-8bb01123-bb92-4b41-9de6-062bd0d561d9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:05:56.959268 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-8bb01123-bb92-4b41-9de6-062bd0d561d9 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.397229 Aug 30 05:05:56.959268 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 19/39] 10.222.0.77 () {60 vars in 1190 bytes} [Tue Aug 30 05:05:56 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 05:05:56.965576 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-55b9a6ea-7232-44d8-b235-fbaeef97c2e1 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:56.970261 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:56.991367 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-55b9a6ea-7232-44d8-b235-fbaeef97c2e1 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029377 Aug 30 05:05:56.991904 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 21/40] 10.222.0.77 () {60 vars in 1210 bytes} [Tue Aug 30 05:05:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:05:57.001548 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-19014be8-ea9f-419a-ae7b-8593c8e9a633 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:57.024105 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-19014be8-ea9f-419a-ae7b-8593c8e9a633 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026092 Aug 30 05:05:57.024629 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 20/41] 10.222.0.77 () {60 vars in 1210 bytes} [Tue Aug 30 05:05:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:05:57.035472 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-cac0c632-5837-40fc-9e4b-de2807eac7d3 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:57.041588 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.wsgi [None req-cac0c632-5837-40fc-9e4b-de2807eac7d3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-cac0c632-5837-40fc-9e4b-de2807eac7d3 admin admin] Request method failure captured: Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Accept: application/json Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Accept-Encoding: gzip, deflate Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Connection: keep-alive Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Content-Length: 0 Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Host: 10.222.0.77 Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Openstack-Api-Version: compute 2.90 Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Openstack-System-Scope: None Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: User-Agent: python-novaclient Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Auth-Token: gAAAAABjDZq0oO35ma6Lb1gVc8OSyNEmnHPn08wdI6Rt1Z7sEinpY-6EjiaySKbARK_rqZRovv1-_M1F3fo3Dj7EE5RTOAyPO_7ZKwX4cTO_8gcVvWHpvpEi5H3I_WUx7LXRil36FwIooOrixw4IpvHA8wVRhfoSSbMw37VrAnJ9UH1tqnAnhUw Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Domain-Id: None Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Domain-Name: None Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Identity-Status: Confirmed Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Is-Admin-Project: True Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Project-Domain-Id: default Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Project-Domain-Name: Default Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Project-Id: 46478c740f59492585d5babfa714b5b5 Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Project-Name: admin Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Role: reader,member,admin Aug 30 05:05:57.044906 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Roles: reader,member,admin Aug 30 05:05:57.046427 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/46478c740f59492585d5babfa714b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/46478c740f59492585d5babfa714b5b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/46478c740f59492585d5babfa714b5b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_46478c740f59492585d5babfa714b5b5", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:05:57.046427 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Tenant: admin Aug 30 05:05:57.046427 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Tenant-Id: 46478c740f59492585d5babfa714b5b5 Aug 30 05:05:57.046427 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Tenant-Name: admin Aug 30 05:05:57.046427 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-User: admin Aug 30 05:05:57.046427 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-User-Domain-Id: default Aug 30 05:05:57.046427 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-User-Domain-Name: Default Aug 30 05:05:57.046427 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-User-Id: fdab92bac3f64739a0fcb5f729d40f85 Aug 30 05:05:57.046427 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-User-Name: admin Aug 30 05:05:57.046427 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: method: > Aug 30 05:05:57.046427 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: exception: Flavor 42 could not be found. Aug 30 05:05:57.046427 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: action_args: {'id': '42'} Aug 30 05:05:57.046427 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:05:57.046427 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:05:57.047354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Aug 30 05:05:57.048656 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-cac0c632-5837-40fc-9e4b-de2807eac7d3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:05:57.049882 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-cac0c632-5837-40fc-9e4b-de2807eac7d3 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016044 Aug 30 05:05:57.049882 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 22/42] 10.222.0.77 () {60 vars in 1190 bytes} [Tue Aug 30 05:05:57 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 05:05:58.004538 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-19014be8-ea9f-419a-ae7b-8593c8e9a633 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:58.005537 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-19014be8-ea9f-419a-ae7b-8593c8e9a633 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 30 05:05:58.005929 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 21/43] 10.222.0.77 () {56 vars in 1074 bytes} [Tue Aug 30 05:05:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:58.537696 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-998f284d-bc62-4572-8c0a-762d13a0d45f admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:58.543035 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.wsgi [None req-998f284d-bc62-4572-8c0a-762d13a0d45f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-998f284d-bc62-4572-8c0a-762d13a0d45f admin admin] Request method failure captured: Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Accept: application/json Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Accept-Encoding: gzip, deflate Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Connection: keep-alive Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Content-Length: 0 Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Host: 10.222.0.77 Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Openstack-Api-Version: compute 2.90 Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Openstack-System-Scope: None Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: User-Agent: python-novaclient Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Auth-Token: gAAAAABjDZq1mBqAQKbqsvNc587D57K_DCnN4qWgIzHw9jYCfedabbUcGwVoixIRqXttsLxRD7HZZ-DZgT1pp3HxC1mPC9_O4pdblJlf4WxPwjS9ZWQAEf2CBBziMkjXImYwnxPiuZrQz0L9lQqRsYyMPIuhNTQQJOzHCzPJ3BLuMy-cJAhvis8 Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Domain-Id: None Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Domain-Name: None Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Identity-Status: Confirmed Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Is-Admin-Project: True Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Project-Domain-Id: default Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Project-Domain-Name: Default Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Project-Id: 46478c740f59492585d5babfa714b5b5 Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Project-Name: admin Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Role: reader,member,admin Aug 30 05:05:58.544551 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Roles: reader,member,admin Aug 30 05:05:58.546077 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/46478c740f59492585d5babfa714b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/46478c740f59492585d5babfa714b5b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/46478c740f59492585d5babfa714b5b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_46478c740f59492585d5babfa714b5b5", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:05:58.546077 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Tenant: admin Aug 30 05:05:58.546077 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Tenant-Id: 46478c740f59492585d5babfa714b5b5 Aug 30 05:05:58.546077 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Tenant-Name: admin Aug 30 05:05:58.546077 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-User: admin Aug 30 05:05:58.546077 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-User-Domain-Id: default Aug 30 05:05:58.546077 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-User-Domain-Name: Default Aug 30 05:05:58.546077 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-User-Id: fdab92bac3f64739a0fcb5f729d40f85 Aug 30 05:05:58.546077 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-User-Name: admin Aug 30 05:05:58.546077 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: method: > Aug 30 05:05:58.546077 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: exception: Flavor 84 could not be found. Aug 30 05:05:58.546077 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: action_args: {'id': '84'} Aug 30 05:05:58.546077 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:05:58.546077 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:05:58.547230 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Aug 30 05:05:58.548587 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-998f284d-bc62-4572-8c0a-762d13a0d45f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:05:58.549894 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-998f284d-bc62-4572-8c0a-762d13a0d45f admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.401757 Aug 30 05:05:58.549894 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 23/44] 10.222.0.77 () {60 vars in 1190 bytes} [Tue Aug 30 05:05:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 05:05:58.555482 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-4c5df5f4-4537-4b7b-83a5-63a60dda2a31 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:58.570199 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-4c5df5f4-4537-4b7b-83a5-63a60dda2a31 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018231 Aug 30 05:05:58.570722 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 22/45] 10.222.0.77 () {60 vars in 1210 bytes} [Tue Aug 30 05:05:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:05:58.580359 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-aa132f67-2129-4e81-b139-5059a44d65b9 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:58.595609 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-aa132f67-2129-4e81-b139-5059a44d65b9 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019251 Aug 30 05:05:58.596115 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 24/46] 10.222.0.77 () {60 vars in 1210 bytes} [Tue Aug 30 05:05:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:05:58.605289 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-e7e6865e-9374-422a-a9a7-4400d3a474db admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:58.610425 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.wsgi [None req-e7e6865e-9374-422a-a9a7-4400d3a474db admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-e7e6865e-9374-422a-a9a7-4400d3a474db admin admin] Request method failure captured: Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Accept: application/json Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Accept-Encoding: gzip, deflate Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Connection: keep-alive Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Content-Length: 0 Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Host: 10.222.0.77 Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Openstack-Api-Version: compute 2.90 Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Openstack-System-Scope: None Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: User-Agent: python-novaclient Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Auth-Token: gAAAAABjDZq1mBqAQKbqsvNc587D57K_DCnN4qWgIzHw9jYCfedabbUcGwVoixIRqXttsLxRD7HZZ-DZgT1pp3HxC1mPC9_O4pdblJlf4WxPwjS9ZWQAEf2CBBziMkjXImYwnxPiuZrQz0L9lQqRsYyMPIuhNTQQJOzHCzPJ3BLuMy-cJAhvis8 Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Domain-Id: None Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Domain-Name: None Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Identity-Status: Confirmed Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Is-Admin-Project: True Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Project-Domain-Id: default Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Project-Domain-Name: Default Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Project-Id: 46478c740f59492585d5babfa714b5b5 Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Project-Name: admin Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Role: reader,member,admin Aug 30 05:05:58.611943 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Roles: reader,member,admin Aug 30 05:05:58.613408 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/46478c740f59492585d5babfa714b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/46478c740f59492585d5babfa714b5b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/46478c740f59492585d5babfa714b5b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_46478c740f59492585d5babfa714b5b5", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:05:58.613408 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Tenant: admin Aug 30 05:05:58.613408 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Tenant-Id: 46478c740f59492585d5babfa714b5b5 Aug 30 05:05:58.613408 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Tenant-Name: admin Aug 30 05:05:58.613408 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-User: admin Aug 30 05:05:58.613408 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-User-Domain-Id: default Aug 30 05:05:58.613408 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-User-Domain-Name: Default Aug 30 05:05:58.613408 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-User-Id: fdab92bac3f64739a0fcb5f729d40f85 Aug 30 05:05:58.613408 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-User-Name: admin Aug 30 05:05:58.613408 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: method: > Aug 30 05:05:58.613408 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: exception: Flavor 84 could not be found. Aug 30 05:05:58.613408 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: action_args: {'id': '84'} Aug 30 05:05:58.613408 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:05:58.613408 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:05:58.614381 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Aug 30 05:05:58.615883 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-e7e6865e-9374-422a-a9a7-4400d3a474db admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:05:58.617104 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-e7e6865e-9374-422a-a9a7-4400d3a474db admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011395 Aug 30 05:05:58.617104 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 23/47] 10.222.0.77 () {60 vars in 1190 bytes} [Tue Aug 30 05:05:58 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 05:05:59.567775 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-aa132f67-2129-4e81-b139-5059a44d65b9 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:59.568780 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-aa132f67-2129-4e81-b139-5059a44d65b9 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 30 05:05:59.569174 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 25/48] 10.222.0.77 () {56 vars in 1074 bytes} [Tue Aug 30 05:05:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:06:00.086698 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-4ab7cb01-0935-452a-8155-70b90722a633 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:00.092444 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.wsgi [None req-4ab7cb01-0935-452a-8155-70b90722a633 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-4ab7cb01-0935-452a-8155-70b90722a633 admin admin] Request method failure captured: Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Accept: application/json Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Accept-Encoding: gzip, deflate Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Connection: keep-alive Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Content-Length: 0 Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Host: 10.222.0.77 Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Openstack-Api-Version: compute 2.90 Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Openstack-System-Scope: None Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: User-Agent: python-novaclient Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Auth-Token: gAAAAABjDZq343KfazdmoVtwWYE8kpH8ooTlSc2bsgPV2W2vQaYvll7NbZyfErdE76pPO56vouI7ukL2phC0QALaM16NeNNCOJspt8sIhxjjKCWja_DOikf185h6JlM5sO5Kk2QhI2SLWKaroW60GF0ETdXn3lsz0ImMt8LDTLrk8HDLjzpxlV8 Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Domain-Id: None Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Domain-Name: None Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Identity-Status: Confirmed Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Is-Admin-Project: True Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Project-Domain-Id: default Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Project-Domain-Name: Default Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Project-Id: 46478c740f59492585d5babfa714b5b5 Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Project-Name: admin Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Role: reader,member,admin Aug 30 05:06:00.094644 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Roles: reader,member,admin Aug 30 05:06:00.096255 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/46478c740f59492585d5babfa714b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/46478c740f59492585d5babfa714b5b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/46478c740f59492585d5babfa714b5b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_46478c740f59492585d5babfa714b5b5", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:06:00.096255 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Tenant: admin Aug 30 05:06:00.096255 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Tenant-Id: 46478c740f59492585d5babfa714b5b5 Aug 30 05:06:00.096255 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-Tenant-Name: admin Aug 30 05:06:00.096255 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-User: admin Aug 30 05:06:00.096255 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-User-Domain-Id: default Aug 30 05:06:00.096255 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-User-Domain-Name: Default Aug 30 05:06:00.096255 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-User-Id: fdab92bac3f64739a0fcb5f729d40f85 Aug 30 05:06:00.096255 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: X-User-Name: admin Aug 30 05:06:00.096255 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: method: > Aug 30 05:06:00.096255 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: exception: Flavor 451 could not be found. Aug 30 05:06:00.096255 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: action_args: {'id': '451'} Aug 30 05:06:00.096255 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:06:00.096255 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:06:00.098281 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: ERROR nova.api.openstack.wsgi Aug 30 05:06:00.099614 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-4ab7cb01-0935-452a-8155-70b90722a633 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:06:00.101166 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-4ab7cb01-0935-452a-8155-70b90722a633 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389085 Aug 30 05:06:00.101166 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 24/49] 10.222.0.77 () {60 vars in 1193 bytes} [Tue Aug 30 05:05:59 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 05:06:00.105768 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-8d0fc061-27dc-4a29-b096-1214d388025d admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:00.120437 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-8d0fc061-27dc-4a29-b096-1214d388025d admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018229 Aug 30 05:06:00.120955 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 26/50] 10.222.0.77 () {60 vars in 1210 bytes} [Tue Aug 30 05:06:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:06:00.130307 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-aacce544-c7f0-4d46-aa01-00b0fc49c949 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:00.145540 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-aacce544-c7f0-4d46-aa01-00b0fc49c949 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018751 Aug 30 05:06:00.146057 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 25/51] 10.222.0.77 () {60 vars in 1210 bytes} [Tue Aug 30 05:06:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:06:00.154975 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-4149dee7-7a25-4740-92cf-aa3e571ad0e6 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:00.160886 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.wsgi [None req-4149dee7-7a25-4740-92cf-aa3e571ad0e6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-4149dee7-7a25-4740-92cf-aa3e571ad0e6 admin admin] Request method failure captured: Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Accept: application/json Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Accept-Encoding: gzip, deflate Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Connection: keep-alive Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Content-Length: 0 Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Host: 10.222.0.77 Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Openstack-Api-Version: compute 2.90 Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Openstack-System-Scope: None Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: User-Agent: python-novaclient Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Auth-Token: gAAAAABjDZq343KfazdmoVtwWYE8kpH8ooTlSc2bsgPV2W2vQaYvll7NbZyfErdE76pPO56vouI7ukL2phC0QALaM16NeNNCOJspt8sIhxjjKCWja_DOikf185h6JlM5sO5Kk2QhI2SLWKaroW60GF0ETdXn3lsz0ImMt8LDTLrk8HDLjzpxlV8 Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Domain-Id: None Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Domain-Name: None Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Identity-Status: Confirmed Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Is-Admin-Project: True Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Project-Domain-Id: default Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Project-Domain-Name: Default Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Project-Id: 46478c740f59492585d5babfa714b5b5 Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Project-Name: admin Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Role: reader,member,admin Aug 30 05:06:00.162390 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Roles: reader,member,admin Aug 30 05:06:00.163938 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/46478c740f59492585d5babfa714b5b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/46478c740f59492585d5babfa714b5b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/46478c740f59492585d5babfa714b5b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_46478c740f59492585d5babfa714b5b5", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:06:00.163938 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Tenant: admin Aug 30 05:06:00.163938 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Tenant-Id: 46478c740f59492585d5babfa714b5b5 Aug 30 05:06:00.163938 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-Tenant-Name: admin Aug 30 05:06:00.163938 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-User: admin Aug 30 05:06:00.163938 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-User-Domain-Id: default Aug 30 05:06:00.163938 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-User-Domain-Name: Default Aug 30 05:06:00.163938 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-User-Id: fdab92bac3f64739a0fcb5f729d40f85 Aug 30 05:06:00.163938 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: X-User-Name: admin Aug 30 05:06:00.163938 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: method: > Aug 30 05:06:00.163938 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: exception: Flavor 451 could not be found. Aug 30 05:06:00.163938 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: action_args: {'id': '451'} Aug 30 05:06:00.163938 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:06:00.163938 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:06:00.164926 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: ERROR nova.api.openstack.wsgi Aug 30 05:06:00.166515 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-4149dee7-7a25-4740-92cf-aa3e571ad0e6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:06:00.167786 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-4149dee7-7a25-4740-92cf-aa3e571ad0e6 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012206 Aug 30 05:06:00.167786 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 27/52] 10.222.0.77 () {60 vars in 1193 bytes} [Tue Aug 30 05:06:00 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 05:06:01.114256 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-aacce544-c7f0-4d46-aa01-00b0fc49c949 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:01.115295 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-aacce544-c7f0-4d46-aa01-00b0fc49c949 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 30 05:06:01.115685 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 26/53] 10.222.0.77 () {56 vars in 1074 bytes} [Tue Aug 30 05:06:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:06:01.631040 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-cada41ce-3821-46d4-876b-43cf7ea35005 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:06:01.649945 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-cada41ce-3821-46d4-876b-43cf7ea35005 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.398084 Aug 30 05:06:01.650492 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 28/54] 10.222.0.77 () {64 vars in 1235 bytes} [Tue Aug 30 05:06:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:06:02.609057 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-aacce544-c7f0-4d46-aa01-00b0fc49c949 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:02.610564 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-aacce544-c7f0-4d46-aa01-00b0fc49c949 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001924 Aug 30 05:06:02.610999 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 27/55] 10.222.0.77 () {56 vars in 1074 bytes} [Tue Aug 30 05:06:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:06:03.128700 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-a1ccbe19-8200-4efc-b994-c378f92e411d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:06:03.146939 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-a1ccbe19-8200-4efc-b994-c378f92e411d admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.398410 Aug 30 05:06:03.147476 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 29/56] 10.222.0.77 () {64 vars in 1235 bytes} [Tue Aug 30 05:06:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:06:04.112495 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-aacce544-c7f0-4d46-aa01-00b0fc49c949 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:04.113504 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-aacce544-c7f0-4d46-aa01-00b0fc49c949 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 30 05:06:04.113899 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 28/57] 10.222.0.77 () {56 vars in 1074 bytes} [Tue Aug 30 05:06:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:06:04.633113 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-88fff2db-452f-42f9-804e-62e6fbc04f13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:06:04.651720 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-88fff2db-452f-42f9-804e-62e6fbc04f13 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.397877 Aug 30 05:06:04.652242 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 30/58] 10.222.0.77 () {64 vars in 1235 bytes} [Tue Aug 30 05:06:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:06:05.612118 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-aacce544-c7f0-4d46-aa01-00b0fc49c949 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:05.613125 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-aacce544-c7f0-4d46-aa01-00b0fc49c949 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 30 05:06:05.613518 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 29/59] 10.222.0.77 () {56 vars in 1074 bytes} [Tue Aug 30 05:06:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:06:06.135910 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-8a8f586a-b8ee-427f-b989-b6abd7cc58a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:06:06.154522 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-8a8f586a-b8ee-427f-b989-b6abd7cc58a5 admin admin] 10.222.0.77 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.398582 Aug 30 05:06:06.155088 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 31/60] 10.222.0.77 () {64 vars in 1235 bytes} [Tue Aug 30 05:06:05 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:06:07.122859 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-aacce544-c7f0-4d46-aa01-00b0fc49c949 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:07.124438 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-aacce544-c7f0-4d46-aa01-00b0fc49c949 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002517 Aug 30 05:06:07.125600 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 30/61] 10.222.0.77 () {56 vars in 1074 bytes} [Tue Aug 30 05:06:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:06:07.642404 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-299ecd02-d545-46ae-bc22-c551b8895689 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:07.662948 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-299ecd02-d545-46ae-bc22-c551b8895689 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.399168 Aug 30 05:06:07.663472 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 32/62] 10.222.0.77 () {60 vars in 1202 bytes} [Tue Aug 30 05:06:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:07:00.369394 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-aacce544-c7f0-4d46-aa01-00b0fc49c949 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:00.370436 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-aacce544-c7f0-4d46-aa01-00b0fc49c949 admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 30 05:07:00.370861 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 31/63] 10.222.0.77 () {54 vars in 931 bytes} [Tue Aug 30 05:07:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:07:00.381355 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:00.758069 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-658c787c-cb26-4795-9e8c-a4a6d2f03370 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:00.778806 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-658c787c-cb26-4795-9e8c-a4a6d2f03370 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401906 Aug 30 05:07:00.779351 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 33/64] 10.222.0.77 () {60 vars in 1292 bytes} [Tue Aug 30 05:07:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:07:00.800256 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG dbcounter [-] [105597] Writing DB stats nova_api:SELECT=14 {{(pid=105597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:00.804190 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-9732f12b-beb9-485e-8db3-78771f27c2e4 admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:00.811698 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-9732f12b-beb9-485e-8db3-78771f27c2e4 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012884 Aug 30 05:07:00.812230 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 32/65] 10.222.0.77 () {60 vars in 1283 bytes} [Tue Aug 30 05:07:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:00.823389 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-03728e49-072f-4360-8a34-58978e6cdfd1 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:00.831348 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-03728e49-072f-4360-8a34-58978e6cdfd1 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011506 Aug 30 05:07:00.831841 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 34/66] 10.222.0.77 () {60 vars in 1286 bytes} [Tue Aug 30 05:07:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:00.842654 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-b76d18b2-7f33-488c-9044-70e99b4d17fc admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:00.850791 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-b76d18b2-7f33-488c-9044-70e99b4d17fc admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011468 Aug 30 05:07:00.851324 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 33/67] 10.222.0.77 () {60 vars in 1286 bytes} [Tue Aug 30 05:07:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:00.862000 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-f3d68c3a-7792-412b-b729-753f74e281f9 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:00.869346 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-f3d68c3a-7792-412b-b729-753f74e281f9 admin admin] 10.222.0.77 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010644 Aug 30 05:07:00.869837 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 35/68] 10.222.0.77 () {60 vars in 1283 bytes} [Tue Aug 30 05:07:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:09:52.989165 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-b76d18b2-7f33-488c-9044-70e99b4d17fc admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:09:52.990174 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-b76d18b2-7f33-488c-9044-70e99b4d17fc admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 30 05:09:52.990568 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 34/69] 10.222.0.77 () {56 vars in 1074 bytes} [Tue Aug 30 05:09:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:09:53.131098 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_api:SELECT=6 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:53.297157 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-960d07b7-fd07-4b42-bcc8-d60d93f1e2a6 admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:09:53.300850 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-960d07b7-fd07-4b42-bcc8-d60d93f1e2a6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:09:53.301423 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-960d07b7-fd07-4b42-bcc8-d60d93f1e2a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:09:53.301916 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-960d07b7-fd07-4b42-bcc8-d60d93f1e2a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:09:53.302703 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-960d07b7-fd07-4b42-bcc8-d60d93f1e2a6 admin admin] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:09:53.303277 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-960d07b7-fd07-4b42-bcc8-d60d93f1e2a6 admin admin] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:09:53.303766 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-960d07b7-fd07-4b42-bcc8-d60d93f1e2a6 admin admin] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:09:53.336993 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-960d07b7-fd07-4b42-bcc8-d60d93f1e2a6 admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.207353 Aug 30 05:09:53.337531 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 36/70] 10.222.0.77 () {60 vars in 1193 bytes} [Tue Aug 30 05:09:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:09:54.165624 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-b76d18b2-7f33-488c-9044-70e99b4d17fc admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:09:54.166628 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-b76d18b2-7f33-488c-9044-70e99b4d17fc admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 30 05:09:54.167059 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 35/71] 10.222.0.77 () {56 vars in 1074 bytes} [Tue Aug 30 05:09:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:09:54.360469 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-02680e6b-c45f-479e-b9e2-694cda9d41eb admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:09:54.363892 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-02680e6b-c45f-479e-b9e2-694cda9d41eb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:09:54.364354 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-02680e6b-c45f-479e-b9e2-694cda9d41eb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:09:54.364771 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-02680e6b-c45f-479e-b9e2-694cda9d41eb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:09:54.365463 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-02680e6b-c45f-479e-b9e2-694cda9d41eb admin admin] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:09:54.365894 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-02680e6b-c45f-479e-b9e2-694cda9d41eb admin admin] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:09:54.366295 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-02680e6b-c45f-479e-b9e2-694cda9d41eb admin admin] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:09:54.385156 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-02680e6b-c45f-479e-b9e2-694cda9d41eb admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077032 Aug 30 05:09:54.385635 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 37/72] 10.222.0.77 () {60 vars in 1193 bytes} [Tue Aug 30 05:09:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:10:05.606019 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-b76d18b2-7f33-488c-9044-70e99b4d17fc admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:05.607057 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-b76d18b2-7f33-488c-9044-70e99b4d17fc admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 30 05:10:05.607455 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 36/73] 10.222.0.77 () {56 vars in 1074 bytes} [Tue Aug 30 05:10:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:10:05.750003 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_cell0:SELECT=4 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:05.750724 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_cell1:SELECT=4 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:05.751881 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG dbcounter [-] [105598] Writing DB stats nova_api:SELECT=8 {{(pid=105598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:05.798521 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-f912d5dd-376d-4111-8fa4-6ab2955bd9bd admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:05.801862 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-f912d5dd-376d-4111-8fa4-6ab2955bd9bd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:05.802352 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-f912d5dd-376d-4111-8fa4-6ab2955bd9bd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:05.802769 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-f912d5dd-376d-4111-8fa4-6ab2955bd9bd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:05.803491 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-f912d5dd-376d-4111-8fa4-6ab2955bd9bd admin admin] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:05.803930 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-f912d5dd-376d-4111-8fa4-6ab2955bd9bd admin admin] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:05.804337 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-f912d5dd-376d-4111-8fa4-6ab2955bd9bd admin admin] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:05.828612 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-f912d5dd-376d-4111-8fa4-6ab2955bd9bd admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083402 Aug 30 05:10:05.829671 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 38/74] 10.222.0.77 () {60 vars in 1193 bytes} [Tue Aug 30 05:10:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:10:06.647398 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: DEBUG nova.api.openstack.wsgi [None req-b76d18b2-7f33-488c-9044-70e99b4d17fc admin admin] Calling method '>' {{(pid=105597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:06.648403 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: INFO nova.api.openstack.requestlog [None req-b76d18b2-7f33-488c-9044-70e99b4d17fc admin admin] 10.222.0.77 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 30 05:10:06.648800 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: [pid: 105597|app: 0|req: 37/75] 10.222.0.77 () {56 vars in 1074 bytes} [Tue Aug 30 05:10:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:10:06.838397 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG nova.api.openstack.wsgi [None req-fc486a85-aac6-4e31-a8fb-b461ed9e2c7d admin admin] Calling method '>' {{(pid=105598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:06.841837 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-fc486a85-aac6-4e31-a8fb-b461ed9e2c7d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:06.842305 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-fc486a85-aac6-4e31-a8fb-b461ed9e2c7d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:06.842736 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-fc486a85-aac6-4e31-a8fb-b461ed9e2c7d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:06.843477 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-fc486a85-aac6-4e31-a8fb-b461ed9e2c7d admin admin] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:06.843920 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-fc486a85-aac6-4e31-a8fb-b461ed9e2c7d admin admin] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:06.844330 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: DEBUG oslo_concurrency.lockutils [None req-fc486a85-aac6-4e31-a8fb-b461ed9e2c7d admin admin] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:06.867077 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: INFO nova.api.openstack.requestlog [None req-fc486a85-aac6-4e31-a8fb-b461ed9e2c7d admin admin] 10.222.0.77 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079338 Aug 30 05:10:06.867612 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: [pid: 105598|app: 0|req: 39/76] 10.222.0.77 () {60 vars in 1193 bytes} [Tue Aug 30 05:10:06 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:11:04.424750 dv-cinder-853910-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 05:11:04.425264 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: Tue Aug 30 05:11:04 2022 - graceful shutdown triggered... Aug 30 05:11:04.425739 dv-cinder-853910-4-iscsi devstack@n-api.service[105597]: Gracefully killing worker 1 (pid: 105597)... Aug 30 05:11:04.426160 dv-cinder-853910-4-iscsi devstack@n-api.service[105598]: Gracefully killing worker 2 (pid: 105598)... Aug 30 05:11:05.426342 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: worker 1 buried after 1 seconds Aug 30 05:11:05.426949 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: worker 2 buried after 1 seconds Aug 30 05:11:05.426949 dv-cinder-853910-4-iscsi devstack@n-api.service[105596]: goodbye to uWSGI. Aug 30 05:11:05.427986 dv-cinder-853910-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 30 05:11:05.428540 dv-cinder-853910-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 05:11:05.431371 dv-cinder-853910-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 05:11:05.444733 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 05:11:05.446758 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 05:11:05 2022] *** Aug 30 05:11:05.446758 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 05:11:05.446758 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 05:11:05.446758 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: nodename: dv-cinder-853910-4-iscsi Aug 30 05:11:05.446758 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: machine: x86_64 Aug 30 05:11:05.446758 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: clock source: unix Aug 30 05:11:05.446758 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: pcre jit disabled Aug 30 05:11:05.446758 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: detected number of CPU cores: 4 Aug 30 05:11:05.446758 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: current working directory: / Aug 30 05:11:05.446758 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: detected binary path: /usr/bin/uwsgi-core Aug 30 05:11:05.447555 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: your processes number limit is 47680 Aug 30 05:11:05.447555 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: your memory page size is 4096 bytes Aug 30 05:11:05.447555 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: detected max file descriptor number: 2048 Aug 30 05:11:05.447555 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: lock engine: pthread robust mutexes Aug 30 05:11:05.447555 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: thunder lock: enabled Aug 30 05:11:05.447555 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 05:11:05.447555 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 05:11:05.489356 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: Python main interpreter initialized at 0x55f31e7119c0 Aug 30 05:11:05.489356 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: python threads support enabled Aug 30 05:11:05.489356 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: your server socket listen backlog is limited to 100 connections Aug 30 05:11:05.489356 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: your mercy for graceful operations on workers is 90 seconds Aug 30 05:11:05.489822 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 05:11:05.489822 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: *** Operational MODE: preforking *** Aug 30 05:11:05.490077 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: *** uWSGI is running in multiple interpreter mode *** Aug 30 05:11:05.490077 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: spawned uWSGI master process (pid: 120552) Aug 30 05:11:05.490285 dv-cinder-853910-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 05:11:05.490902 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: spawned uWSGI worker 1 (pid: 120572, cores: 1) Aug 30 05:11:05.492403 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: spawned uWSGI worker 2 (pid: 120573, cores: 1) Aug 30 05:11:05.492403 dv-cinder-853910-4-iscsi devstack@n-api.service[120552]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 05:11:06.151418 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 05:11:06.157551 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 05:11:07.310727 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 05:11:07.310727 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: from cryptography.utils import int_from_bytes Aug 30 05:11:07.311377 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 05:11:07.311377 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: from cryptography.utils import int_from_bytes Aug 30 05:11:07.316932 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 05:11:07.316932 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: from cryptography.utils import int_from_bytes Aug 30 05:11:07.317373 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 05:11:07.317373 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: from cryptography.utils import int_from_bytes Aug 30 05:11:09.703803 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 05:11:09.704363 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 05:11:09.704518 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 05:11:09.705177 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 05:11:09.706835 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 05:11:09.707452 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.707990 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.708515 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.709042 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.709724 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.710244 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.710774 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.711312 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.711857 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.712322 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.712839 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.713366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-4-iscsi {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.713891 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.714393 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.714939 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.715465 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.715970 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.716489 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.717007 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.717819 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.718355 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.718873 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.719385 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.719922 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.720434 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.721197 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.721719 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.722225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.722801 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.723353 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.723951 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-4-iscsi {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.724484 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.724998 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.725508 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.726137 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.726650 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.727227 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.727754 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.728278 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.728779 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.729300 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.729819 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.730338 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.730869 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.731193 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 05:11:09.731639 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 05:11:09.731981 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 05:11:09.732191 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.732347 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 05:11:09.732603 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 05:11:09.732996 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.733220 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.733330 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.733639 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.733962 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.734249 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.734430 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.734755 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.735159 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.735307 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.735621 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.735959 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.736148 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.736254 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.736533 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.736871 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853910-4-iscsi {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.737114 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.737229 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.737516 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.737832 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.738535 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.738687 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.739042 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.739376 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.739610 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.739721 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.740193 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.740431 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.740537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.740801 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.741114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.741423 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.741525 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.741759 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.742074 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.742398 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.742511 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.742708 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.743080 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.743328 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.743441 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.743792 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853910-4-iscsi {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.744114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.744297 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.744445 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.744746 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.745139 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.745258 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.745469 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.745785 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.746111 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.746307 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.746421 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.746732 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.747088 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.747301 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.747412 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.747725 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.748047 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.748269 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.748377 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.748654 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.748968 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.749256 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.749372 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.749585 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.749895 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.750147 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.750393 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.750493 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.750767 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.751224 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.751337 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.751653 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.751914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.752169 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.752374 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.752483 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.752802 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.753114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.753345 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.753638 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.754536 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.754891 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.755095 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.755429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.755748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.756065 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.756281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.756396 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.756690 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.757012 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.757317 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.757427 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.757646 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.757974 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.758365 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.758475 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.758635 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.759172 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.759289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.759540 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.759871 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.760186 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.760428 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.760536 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.760822 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.761135 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.761445 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.761759 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.761959 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.77 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.762065 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.762404 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.762717 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.762836 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.77 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.763372 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.763637 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.763958 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.764277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.764545 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.764659 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.764906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.765221 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.765534 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.765808 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.765909 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.766138 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.766449 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.766762 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.767072 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.767184 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.767421 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.767732 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.768046 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.768314 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.768422 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.768651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.768973 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.769334 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.769594 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.769694 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.769952 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.770264 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.770579 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.770784 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.770924 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.771246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.771563 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.771843 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.771952 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.772187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.772498 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.772821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.773079 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.773187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.773431 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.773757 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.774061 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.774297 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.774410 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.774680 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.775064 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.775384 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.775486 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.775689 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.775998 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.776307 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.777192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.777279 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.777279 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.777279 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.777486 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.777804 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.778131 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.778412 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.778528 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.778745 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.779092 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.779414 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.779650 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.779750 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.780085 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.780437 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.780674 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.780774 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.781084 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.781419 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.781695 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.781804 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.782050 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.782371 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.782706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.782974 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.783069 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.783355 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.783673 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.784005 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.784107 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.784328 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.784663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.785025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.785249 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.785356 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.785662 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.785980 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.786266 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.786379 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.786626 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.787107 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.787503 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.787830 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.788067 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.788166 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.788525 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.788847 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.789077 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.789177 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.789501 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.789819 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.790156 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.790444 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.790546 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.790802 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.791263 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.791552 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.791663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.791901 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.792222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.792554 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.792750 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.792858 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.793177 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.793495 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.793779 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.793889 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.794117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.794463 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.794785 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.795016 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.795542 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.795656 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.795961 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.796286 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.796612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.796912 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.797020 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.797249 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.797573 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.797888 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.798155 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.798264 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.798499 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.798843 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.799166 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.799418 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.799527 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.799820 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.800133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.800476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.801256 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.801356 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.801610 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.801929 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.802248 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.802461 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.802560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.802887 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.803209 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.803525 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.803627 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.803853 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.804171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.804484 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.804746 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.804855 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.805113 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.805427 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.805747 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.805984 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.806093 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.806368 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.806687 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.807050 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.807153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.807377 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.807801 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.808010 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.808355 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.808573 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.808672 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.808985 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.809313 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.809603 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.809704 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.809954 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.810265 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.810579 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.810856 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.811198 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.811516 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.811829 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.812111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.812223 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.812444 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.812755 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.813066 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.813327 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.813427 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.813672 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.814000 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.814313 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.814542 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.814641 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.815024 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.815344 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.815623 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.815733 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.815994 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.816398 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.817206 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.817318 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.817558 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.817893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.818216 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.818437 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.818543 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.818847 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.819175 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.819482 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.819596 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.819805 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.820134 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.820454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.820707 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.820807 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.821085 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.821414 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.821713 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.821829 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.822049 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.822360 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.822680 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.822958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.823156 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.823502 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.823827 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.824065 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.824164 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.824459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.824777 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.825073 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.825175 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.825398 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.825716 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.826033 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.826293 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.826393 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.826666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.827015 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.827332 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.827446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.827657 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.827979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.828306 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.828558 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.828667 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.828919 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.829255 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.829574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.829684 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.829889 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.830208 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.830535 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.830871 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.830975 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.831300 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.831616 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.831943 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.832055 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.832262 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.832580 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.832900 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.833153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.833252 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.833518 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.833828 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.834147 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.834354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.834453 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.834756 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.835145 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.835394 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.835494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.835788 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.836106 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.836438 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.836623 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 05:11:09.836778 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.837063 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.837373 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.837702 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.837936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.838043 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.838317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.838627 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.838997 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.839174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.839344 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.839664 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.839975 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.840297 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.840480 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.840654 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.840934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.841254 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.841574 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.841683 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.841886 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.842215 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.842533 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.842874 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.842979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.843221 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.843544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.843859 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.844119 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.844235 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.844487 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.844801 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.845119 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.845436 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.845858 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.846014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.846313 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.846634 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.846975 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.847290 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.847739 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.847927 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.848263 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.848587 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.848854 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.848955 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.849254 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.849590 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.849892 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.850003 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.850231 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.850543 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.850926 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.851163 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.851263 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.851553 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.851870 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.852163 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.852272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.852481 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.852791 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.853105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.853397 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.853499 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.853712 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.854021 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.854332 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.854620 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.854721 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.855008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.855333 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.855642 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.855900 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.856009 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.856270 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.856581 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.856889 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.857149 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.857258 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.857530 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.857839 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.858166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.858279 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.858506 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.858903 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.859225 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.859414 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.859518 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.859848 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.860158 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.860443 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.860544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.860763 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.861075 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.861388 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.861673 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.861783 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.862476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.862476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.862632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.862952 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.863775 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.864089 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.864368 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.864470 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.864704 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.865023 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.865335 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.865601 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.865710 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.865952 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.866261 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.866570 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.866892 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.867059 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.867333 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.867658 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.867969 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.868203 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.868318 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.868581 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.868897 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.869213 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.869451 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.869559 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.869842 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.870160 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.870472 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.870667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.870775 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.871151 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.871467 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.871726 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.871836 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.872082 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.872410 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.872734 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.872970 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.873069 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.873343 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.873655 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.873968 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.874185 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.874283 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.874577 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.874942 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.875232 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.875332 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.875555 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.875870 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.876157 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.876331 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.876650 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.876966 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.877266 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.877382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.877571 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.877836 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.878202 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.878440 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.878598 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.879383 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.879710 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.879980 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.880103 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.880388 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.880714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.880881 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.881723 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.881723 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.881723 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.882146 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.882396 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.882656 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.882873 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.883268 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.883438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.883561 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.883788 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.884027 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.884135 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.884371 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.884469 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.884710 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.884807 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.885036 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.885132 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.885363 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.885459 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.885694 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.885788 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.886005 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.886112 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.886324 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.886419 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.886643 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.886743 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.887045 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.887379 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.887559 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.887712 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.887870 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.888025 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.888199 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.888378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.888620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.888770 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.888911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.889054 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.889195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.889348 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.889521 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.889764 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.889932 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.890095 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.890238 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.890389 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.890531 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.890673 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.890910 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.891071 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.891217 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.891441 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.891614 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.891765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.891916 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.892097 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.892262 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.892412 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.892564 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.892715 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.892866 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.893008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.893163 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.893315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.893466 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.893626 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.893780 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.893932 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.894082 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.894226 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.894412 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.894606 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.894877 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.895045 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.895266 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.895416 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.895603 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.895763 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.895924 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.896197 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.896354 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.896541 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.896692 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.896842 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.897081 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.897243 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.897443 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.897594 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.897772 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.897922 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.898083 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.898235 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.898427 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.898597 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.899437 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.899610 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.899610 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.899913 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.900065 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.900217 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.900383 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.900383 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.900782 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.900949 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.901255 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.901573 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.902231 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.902231 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.902620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.903024 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.903373 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.903523 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.903790 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.903948 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.904107 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.904257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.904411 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.904553 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.904902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.905218 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.905392 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.905545 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.905696 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.905841 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.905983 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.906145 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.906290 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.906439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.906602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.907013 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.907360 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.907689 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.907905 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.908063 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.908277 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.908425 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.908616 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.908777 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.909047 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.909206 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.909366 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.909527 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.909670 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.909822 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.910500 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.910678 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.910967 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.911131 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.911276 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.911406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.911537 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.911665 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.911820 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.912723 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.912903 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.913050 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.913145 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.913232 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.913324 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.913410 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.913503 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.913596 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.913699 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.913798 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.913883 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.913974 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.914214 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.914358 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.914615 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.914926 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.915052 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.915249 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.915361 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.915569 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.915687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.915983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.916086 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.916182 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.916384 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.916514 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.916677 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.916859 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.916957 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.917528 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.917643 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.917799 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.917903 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.917989 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.918108 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.918277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.918376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.918533 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.918729 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.918887 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.918997 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.919108 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.919541 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.919713 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.919804 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.919948 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.920050 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.920142 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.920228 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.920845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.920992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.921078 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.921161 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.921264 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.921363 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.921456 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.921563 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.923279 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.924004 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.924106 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.924199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.924291 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.924374 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.924470 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.924556 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.924556 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.924556 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.924556 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.924556 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.924556 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.925013 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.925095 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.925178 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.925259 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.925425 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.925562 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.925642 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.926272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.926427 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.926565 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.926714 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.926931 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.927072 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.927338 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.927488 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.927660 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.927949 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.928050 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.928124 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.928283 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.928425 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.928526 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.928723 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.928870 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.929007 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.929144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.929284 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.929436 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.929575 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.929713 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.929891 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.930032 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.930211 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.930359 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.930536 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.930679 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.930863 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.931002 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.931184 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.931343 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.931492 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.931637 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.931943 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.932108 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.932270 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.932627 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.932768 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.932915 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.933062 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.933199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.933414 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.933562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.933698 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.933840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.933983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.934120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.934279 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.934426 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.934564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.934708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.934708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.934996 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.935153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.935290 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.935432 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.935569 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.935704 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.935852 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.935997 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.936148 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.936286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.936420 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.936562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.936717 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.936855 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.936990 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.937156 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.937345 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.937612 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.937770 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.937931 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.938079 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.938290 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.938915 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.938915 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.939206 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.939346 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.939489 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.939638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.939813 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.939961 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.940156 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.940479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.940568 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.940802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.940965 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.941236 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.941448 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.941609 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.941825 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.942143 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.947540 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.947787 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.947965 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.947965 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.948322 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.948522 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.948693 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.948963 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.949116 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.949283 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.949283 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.949613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.949771 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.949916 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.950096 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.950244 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.950397 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.950542 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.951514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.951674 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.951829 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.951990 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.952211 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.952429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.952576 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.952576 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.952858 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.953920 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.953920 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.954109 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.954262 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.954371 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.954623 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.954623 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.955583 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.955667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.955667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.955818 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.955907 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.955980 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.956060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.956060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.956315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.956404 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.956487 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.956567 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.956567 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.956722 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.956815 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.956887 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.957068 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.957068 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.957230 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.957303 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.957372 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.957456 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.957456 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.957594 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.957664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.957741 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.957818 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.957818 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.957962 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.958035 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.958119 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.958119 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.958263 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.958351 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.958430 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.958430 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.958564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.958643 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.958721 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.959535 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.959718 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.959961 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.960122 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.960347 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.960495 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.960637 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.960791 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.960934 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.961075 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.961228 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.961228 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.961556 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.961701 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.961850 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.962002 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.962002 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.962289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.962434 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.962686 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.962892 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.962892 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.963210 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.963413 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.963571 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.963722 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.963722 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.964007 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.964156 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.964309 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.964460 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.964460 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.964739 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.964902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.965053 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.965195 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.965195 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.965469 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.965625 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.965768 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.965916 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.965916 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.966192 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.966334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.966485 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.966628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.970712 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.970848 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.970960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.971621 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.971713 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.971803 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.971803 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.971953 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.972044 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.972136 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.973109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.973212 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.973395 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.973488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.973604 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.973707 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.973801 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.973801 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.973966 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.974059 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.974150 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.974396 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.974506 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.974594 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.974678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.974762 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.974890 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.974993 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.974993 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.975150 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.975234 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.975317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.975697 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.975697 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.975892 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.975985 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.976078 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.976163 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.976261 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.976353 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.976353 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.976512 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.976597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.977761 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.978457 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.978457 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.978630 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.978716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.978798 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.978920 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.978920 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.979392 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.979488 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.979612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.979713 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.979823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.980575 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.980682 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.981048 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.981189 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.981274 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.981373 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.981466 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.981553 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.981673 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.981767 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.981866 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.981958 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.982043 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.982126 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.982209 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.982291 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.982382 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.982467 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.982553 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.982643 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.982741 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.982856 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.982961 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.983069 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.985911 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.986012 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.986100 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.986194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.986290 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.986376 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.986468 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.986553 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.986631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.986724 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.986809 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.986911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.986988 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.987058 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.987141 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.987223 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.987302 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.987381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.987459 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.987543 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.987630 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.987726 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.987820 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.987907 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.988006 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.988006 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.988175 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.988282 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.988375 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.991383 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.991491 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.991580 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.991674 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.991763 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.991854 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.991940 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.992024 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.992107 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.992203 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.992288 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.992380 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.992505 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.992612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.992707 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.992804 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.992890 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.992973 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.993057 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.993139 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.993222 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.993313 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.993398 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.993496 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.993588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.993683 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.993776 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.993861 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.993953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.994038 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.994109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.994198 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.995061 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.995164 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.995250 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.995334 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.995428 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.995513 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.995611 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.995696 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.995696 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.995839 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.995916 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.996017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.996017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.996179 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.996264 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.996348 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.996348 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.996512 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.996647 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.996647 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.996819 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.996896 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.996966 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.997050 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.997134 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.997212 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.997288 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.997358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.997433 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.997522 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.997594 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.997670 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.997740 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.997822 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.997925 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.998013 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.998097 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.998169 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.998244 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.998327 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.998407 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.998490 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.998569 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.998651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.998735 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.998807 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.999521 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.999619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.999705 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.999795 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.999882 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:09.999969 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.000048 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.000126 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.000210 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.000288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.000366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.000456 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.000528 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.000604 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.000728 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.000802 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.000878 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.000962 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.001040 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.001110 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.001192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.001333 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.001419 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.001506 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.001591 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.001670 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.001747 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.001818 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.001901 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.001992 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.002076 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.002160 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.002232 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.002307 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.002389 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.002472 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.002549 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.002625 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.002702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.003220 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.003347 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.003441 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.003541 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.003657 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.003741 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.003826 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.003913 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.004085 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.004241 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.004407 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.004578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.004744 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.004928 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.005166 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.005404 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.005579 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.005731 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.005889 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.006045 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.006195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.006342 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.006497 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.006646 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.006807 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.006994 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.007163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.007462 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.007620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.007777 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.007935 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.008084 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.008239 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.008396 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.008544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.008745 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.008899 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.009055 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.009216 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.009362 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.009473 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.009596 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.009708 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.009852 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.009967 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.010076 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.010184 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.010378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.010531 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.010688 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.010903 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.011098 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.011268 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.011488 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.011777 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.012093 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.012258 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.012416 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.012416 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.012716 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.012866 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.013111 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.013111 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.013416 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.013416 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.013714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.013872 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.014058 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.014212 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.014368 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.014527 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.014688 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.014864 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.015020 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.015198 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.015443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.015617 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.015775 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.015928 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.016110 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.016271 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.016435 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.016592 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.016742 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.016898 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.017055 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.017212 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.019396 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.019587 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.019762 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.019927 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.020091 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.020256 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.020443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.020607 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.020758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.020907 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.021066 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.021375 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.021694 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.021847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.022023 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.022182 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.022341 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.022504 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.022664 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.022851 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.023020 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.023269 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.023427 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.023592 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.023743 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.023929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.024083 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.024258 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.024457 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.024620 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.024770 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.024919 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.025075 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.025231 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.025390 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.025646 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.025810 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.025961 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.026109 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.026269 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.026433 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.026591 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.026740 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.026740 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 05:11:10.027081 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.027081 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.027081 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.027081 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.027081 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.027081 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.027081 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.027081 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.028218 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.028218 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.028218 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.028218 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.028218 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.028218 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.028218 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.029274 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.029274 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.029274 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.029274 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.029274 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.029274 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.029274 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.030280 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.030280 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.030280 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.030280 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.030280 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.030280 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.031262 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.031262 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.031595 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.031760 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.032009 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.032318 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.032640 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.033169 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.033491 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.033829 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.034160 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.034532 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.034806 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.035710 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.036003 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.036316 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.036625 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.036937 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.037249 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.037558 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.037891 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.038226 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.038517 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.038858 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.039175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.039788 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.040139 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.040460 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.040789 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.041143 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.041434 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.041746 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.042073 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.042383 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.042693 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.043067 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.043452 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.043695 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.044004 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.044318 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.044666 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.044994 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.045244 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.045578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.045882 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.046190 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.046498 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.046832 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.047133 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.047437 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.047743 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.048056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.048366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.048682 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.048990 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.049303 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.049612 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.049929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.050237 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.050600 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.051475 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.051975 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.052127 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.053113 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.053113 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.053113 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.053973 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.053973 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.053973 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.054425 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.054580 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.055115 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.055450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.055775 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.056114 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.056448 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.056761 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.057408 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.057408 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.057710 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.057992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.058307 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.058621 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.058980 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.059436 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.059602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.059892 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.060205 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.060518 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.060869 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.061138 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.061451 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.061763 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.062074 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.062389 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.062737 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.063083 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.063407 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.063731 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.064050 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.064363 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.064676 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.064993 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.065307 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.065627 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.065962 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.066304 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.066615 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.067119 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.067447 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.067770 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.068095 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.068410 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.068733 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.069058 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.069374 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.069701 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.070015 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.070347 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.070690 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.071054 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.071677 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.072043 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.072287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.072880 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.073052 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.073225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.073697 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.073946 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.074131 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.074446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.074764 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.075173 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.075402 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.075692 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.076006 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.076324 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.076615 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.076924 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.077237 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.077852 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.077852 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.078164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.078621 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.078778 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.079569 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.079884 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.080194 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.080531 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.080869 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.081190 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.081516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.082203 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.082203 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.082513 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.082791 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.083418 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.083579 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.083779 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.084117 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.084430 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.084998 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.085211 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO dbcounter [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] Registered counter for database nova_api Aug 30 05:11:10.085474 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.085474 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.085774 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.086301 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.086301 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.086730 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.087184 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.087358 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.087814 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.087975 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.088202 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.088518 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.088853 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.089157 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.089489 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.089775 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.090093 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.090410 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.090733 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.091089 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.091409 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.091724 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.092118 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.092673 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.092673 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.093009 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.093301 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.093858 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.094019 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.094371 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.094732 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.095109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.095392 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.095965 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.096312 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 05:11:10.096512 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 05:11:10.106550 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_db.sqlalchemy.engines [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 05:11:10.114234 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writer thread running {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 05:11:10.159260 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO dbcounter [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] Registered counter for database nova_api Aug 30 05:11:10.170230 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.context [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f3c89321-9723-4736-ac96-a4b564d2d0f3(cell1) {{(pid=120572) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 05:11:10.174246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:10.174730 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:10.176954 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:10.177698 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:10.178171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:10.180210 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:10.180319 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_db.sqlalchemy.engines [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 05:11:10.182252 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO dbcounter [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] Registered counter for database nova_cell0 Aug 30 05:11:10.186321 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO dbcounter [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] Registered counter for database nova_cell1 Aug 30 05:11:10.187230 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writer thread running {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 05:11:10.195241 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_db.sqlalchemy.engines [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 05:11:10.196409 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_db.sqlalchemy.engines [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 05:11:10.203191 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writer thread running {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 05:11:10.204547 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writer thread running {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 05:11:10.243870 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.context [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f3c89321-9723-4736-ac96-a4b564d2d0f3(cell1) {{(pid=120573) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 05:11:10.247935 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:10.248417 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:10.250016 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:10.250750 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:10.251227 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:10.253221 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:10.255272 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO dbcounter [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] Registered counter for database nova_cell0 Aug 30 05:11:10.259325 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO dbcounter [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] Registered counter for database nova_cell1 Aug 30 05:11:10.267156 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_db.sqlalchemy.engines [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 05:11:10.268975 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_db.sqlalchemy.engines [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 05:11:10.275881 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writer thread running {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 05:11:10.277166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writer thread running {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 05:11:10.356329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO dbcounter [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] Registered counter for database nova_cell0 Aug 30 05:11:10.363154 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_db.sqlalchemy.engines [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 05:11:10.367515 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writer thread running {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 05:11:10.424709 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO dbcounter [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] Registered counter for database nova_cell0 Aug 30 05:11:10.431444 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_db.sqlalchemy.engines [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 05:11:10.436032 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writer thread running {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 05:11:10.686453 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: WARNING keystonemiddleware.auth_token [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 05:11:10.694320 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: WARNING keystonemiddleware.auth_token [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 05:11:10.753062 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: WARNING keystonemiddleware.auth_token [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 05:11:10.760872 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: WARNING keystonemiddleware.auth_token [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 05:11:11.042507 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: WARNING keystonemiddleware.auth_token [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 05:11:11.048420 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: WARNING keystonemiddleware.auth_token [None req-2cf50b25-b96b-4798-a062-19f7bc1a362f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 05:11:11.054227 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f31e7119c0 pid: 120572 (default app) Aug 30 05:11:11.105120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: WARNING keystonemiddleware.auth_token [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 05:11:11.111173 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: WARNING keystonemiddleware.auth_token [None req-d58b6668-469a-412d-807f-adb57977c0ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 05:11:11.116968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f31e7119c0 pid: 120573 (default app) Aug 30 05:12:01.162252 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:01.165984 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:01.167684 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:01.170322 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:02.826146 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:02.827283 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:02.833699 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:02.837006 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:03.308212 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1329631114", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452", "networks": [{"uuid": "996ccdc5-b602-44de-84a5-e9a6b62f687d"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:04.495169 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-18bc96a1-85f7-468d-9029-5824773415fa tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Action: 'create', calling method: .version_select at 0x7f822fd7ae50>, body: {"keypair": {"name": "tempest-keypair-158942566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmxK/c16WPw6KiUPwT269tNmp9O0QvTKhXvD+5UciEgXhvOli/Qy29kna25wwi5WBUNaC/pRe2P7U3m8p2C85M3i7Cz6RWeUyFEDuk50qA5auLhJW8xobk3fiSj+ehUjA=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:04.655952 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-18bc96a1-85f7-468d-9029-5824773415fa tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Getting quotas for project 116fb506b7794c1fa9460b5a861de136. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:12:04.678992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-18bc96a1-85f7-468d-9029-5824773415fa tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Getting quotas for user a8f01d0042c84767899dc2b71bca4e12 and project 116fb506b7794c1fa9460b5a861de136. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:12:04.686864 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] validate_networks() for [('996ccdc5-b602-44de-84a5-e9a6b62f687d', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:12:04.811701 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-18bc96a1-85f7-468d-9029-5824773415fa tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.992911 Aug 30 05:12:04.813729 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 1/1] 10.222.0.77 () {60 vars in 1159 bytes} [Tue Aug 30 05:12:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:12:05.703847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-82614851-b56c-4439-bb32-fbae3ae76fa3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Action: 'create', calling method: .version_select at 0x7f822fc0d430>, body: {"keypair": {"name": "tempest-keypair-2073600602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqANyPegZJSFaOhfinZeABYaG9+HyqHCilvCdIvvKYRNWXRdw9tRxWVg4rEWdOaatTaetPfdHziJ7UENoRctVch8JHzth+d+ETppHWZt2HFNz26CJ4tNF0bTuJzXIL8GQ=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:05.741641 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-82614851-b56c-4439-bb32-fbae3ae76fa3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Getting quotas for project 7ea4da0dbf3a44eabbff29f884beb157. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:12:05.758342 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-82614851-b56c-4439-bb32-fbae3ae76fa3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Getting quotas for user 2fe451987a8c49c5b5fc0ef1c9c30ab5 and project 7ea4da0dbf3a44eabbff29f884beb157. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:12:05.860842 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-82614851-b56c-4439-bb32-fbae3ae76fa3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.284564 Aug 30 05:12:05.862189 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 2/2] 10.222.0.77 () {62 vars in 1200 bytes} [Tue Aug 30 05:12:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 291 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 30 05:12:06.616476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:12:06.617497 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:12:06.618396 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:12:06.619076 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:12:06.619762 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:12:06.658036 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:06.658538 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:06.659033 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:06.664624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:06.666556 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:06.672763 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:06.744206 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Getting quotas for project 0ed43db2f368485990e3add370edae5f. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:12:06.764279 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1145004607", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:06.772425 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Getting quotas for user d611a49b03554b448a09fe86604af02b and project 0ed43db2f368485990e3add370edae5f. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:12:06.819116 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:12:06.823857 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:12:07.067856 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-865f6312-9734-487f-b542-0aeb491b65a2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.929734 Aug 30 05:12:07.071373 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 1/3] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:12:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 5938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:12:07.083879 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f435d49c-1e87-46ed-8554-ed6206236dd2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:07.087462 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f435d49c-1e87-46ed-8554-ed6206236dd2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:07.449876 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f435d49c-1e87-46ed-8554-ed6206236dd2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:07.499283 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] validate_networks() for [('16c6adbd-c68c-4f67-83ee-76b6653a3867', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:12:07.505883 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f435d49c-1e87-46ed-8554-ed6206236dd2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1215 microversion: 2.1 time: 0.414432 Aug 30 05:12:07.511807 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 2/4] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:07 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1215 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:08.528813 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f3fc6033-ed2a-48df-b354-3f69084fed5a tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:08.530302 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f3fc6033-ed2a-48df-b354-3f69084fed5a tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:08.749137 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f3fc6033-ed2a-48df-b354-3f69084fed5a tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:08.760948 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f3fc6033-ed2a-48df-b354-3f69084fed5a tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1215 microversion: 2.1 time: 0.237900 Aug 30 05:12:08.763963 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 3/5] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:08 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1215 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:09.375570 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:12:09.376859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:12:09.377558 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:12:09.378190 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:12:09.380095 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:12:09.399715 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:09.402529 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:09.403179 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:09.404575 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:09.407984 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:09.409634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:09.491158 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Getting quotas for project d2ce224c162c414c9be681b76801969c. Resources: {'instances', 'ram', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:12:09.508073 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Getting quotas for user 31cc6aa564be4c569e6fa89813cb9329 and project d2ce224c162c414c9be681b76801969c. Resources: {'instances', 'ram', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:12:09.531664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:12:09.536159 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:12:09.666337 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-408849d1-085c-4772-a943-29e108e322b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.037598 Aug 30 05:12:09.667321 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 3/6] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:12:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 3039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 05:12:09.682080 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a864f846-fecd-4558-91b8-c26279eb7c29 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:09.683149 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a864f846-fecd-4558-91b8-c26279eb7c29 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:09.791427 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e5683970-1f53-4296-a896-7e281d0c082c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:09.802623 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e5683970-1f53-4296-a896-7e281d0c082c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:09.850405 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5683970-1f53-4296-a896-7e281d0c082c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:09.851710 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5683970-1f53-4296-a896-7e281d0c082c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:09.852288 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5683970-1f53-4296-a896-7e281d0c082c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:09.853622 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5683970-1f53-4296-a896-7e281d0c082c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:09.854239 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5683970-1f53-4296-a896-7e281d0c082c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:09.854808 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5683970-1f53-4296-a896-7e281d0c082c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:09.860231 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a864f846-fecd-4558-91b8-c26279eb7c29 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:09.882773 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a864f846-fecd-4558-91b8-c26279eb7c29 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1222 microversion: 2.1 time: 0.207010 Aug 30 05:12:09.896073 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 4/7] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:09 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1222 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:10.183298 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-617713737", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:10.263470 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] validate_networks() for [('16c6adbd-c68c-4f67-83ee-76b6653a3867', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:12:10.541751 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e5683970-1f53-4296-a896-7e281d0c082c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:10.602644 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e5683970-1f53-4296-a896-7e281d0c082c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1219 microversion: 2.1 time: 0.811900 Aug 30 05:12:10.603727 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 4/8] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:09 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1219 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:10.638303 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-839538180", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f19a3a63-4a1b-4d2c-ab3d-dff746819db6"}], "security_groups": [{"name": "tempest-securitygroup--555977442"}], "key_name": "tempest-keypair-158942566", "user_data": "}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:10.969154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] validate_networks() for [('f19a3a63-4a1b-4d2c-ab3d-dff746819db6', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:12:11.458903 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:12:11.460946 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:12:11.461728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:12:11.462299 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:12:11.463006 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:12:11.507787 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:11.510462 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:11.512481 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:11.514414 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:11.517922 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:11.521073 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:11.617895 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Getting quotas for project d2ce224c162c414c9be681b76801969c. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:12:11.635285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Getting quotas for user 31cc6aa564be4c569e6fa89813cb9329 and project d2ce224c162c414c9be681b76801969c. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:12:11.666468 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:12:11.673089 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:12:11.859719 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3a10f357-9514-4946-87b3-b24590424568 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.682637 Aug 30 05:12:11.868871 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 5/9] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:12:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:12:11.880633 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-195936306", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fba3e311-e2c8-4947-8745-e286c874d470"}], "security_groups": [{"name": "tempest-securitygroup--1687391803"}], "key_name": "tempest-keypair-2073600602", "user_data": "}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:11.942834 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:12:11.962050 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:12:11.962666 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:12:11.963117 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:12:11.963544 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:12:11.996510 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:11.998810 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:12.000366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:12.004548 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:12.006180 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:12.009647 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:12.114967 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Getting quotas for project 116fb506b7794c1fa9460b5a861de136. Resources: {'instances', 'ram', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:12:12.125076 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Getting quotas for user a8f01d0042c84767899dc2b71bca4e12 and project 116fb506b7794c1fa9460b5a861de136. Resources: {'instances', 'ram', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:12:12.204402 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:12:12.217259 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:12:12.287621 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] validate_networks() for [('fba3e311-e2c8-4947-8745-e286c874d470', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:12:12.422853 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d151ad66-17fb-4a44-92d9-cfb910316055 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.816988 Aug 30 05:12:12.424663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 5/10] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:12:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 1820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:12:12.433859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-54b0f66d-ece5-43c0-8861-93d23dd593b7 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:12.434844 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-54b0f66d-ece5-43c0-8861-93d23dd593b7 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:12.448590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54b0f66d-ece5-43c0-8861-93d23dd593b7 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:12.450870 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54b0f66d-ece5-43c0-8861-93d23dd593b7 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:12.470673 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54b0f66d-ece5-43c0-8861-93d23dd593b7 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:12.473751 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54b0f66d-ece5-43c0-8861-93d23dd593b7 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:12.475369 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54b0f66d-ece5-43c0-8861-93d23dd593b7 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:12.476298 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54b0f66d-ece5-43c0-8861-93d23dd593b7 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:12.978071 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-54b0f66d-ece5-43c0-8861-93d23dd593b7 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:12.991302 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-54b0f66d-ece5-43c0-8861-93d23dd593b7 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1285 microversion: 2.1 time: 0.562782 Aug 30 05:12:12.994051 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 6/11] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:12 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1285 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:13.003385 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-424ed75b-6e74-4690-9cd1-100d63d486cd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:13.006894 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-424ed75b-6e74-4690-9cd1-100d63d486cd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:13.182133 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-424ed75b-6e74-4690-9cd1-100d63d486cd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:13.244745 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-424ed75b-6e74-4690-9cd1-100d63d486cd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1221 microversion: 2.1 time: 0.249006 Aug 30 05:12:13.245383 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 7/12] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:12 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1221 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:13.278426 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-90c80c69-79b0-43c1-9e32-c91ad138bc31 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:13.283950 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-90c80c69-79b0-43c1-9e32-c91ad138bc31 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:13.458548 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-90c80c69-79b0-43c1-9e32-c91ad138bc31 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:13.495889 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-90c80c69-79b0-43c1-9e32-c91ad138bc31 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1236 microversion: 2.1 time: 0.242731 Aug 30 05:12:13.496482 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 8/13] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:13 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1236 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:13.771476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:12:13.771904 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:12:13.772383 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:12:13.772792 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:12:13.773356 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:12:13.793228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:13.793626 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:13.795531 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:13.798277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:13.802616 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:13.803168 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:13.842406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Getting quotas for project 7ea4da0dbf3a44eabbff29f884beb157. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:12:13.853463 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Getting quotas for user 2fe451987a8c49c5b5fc0ef1c9c30ab5 and project 7ea4da0dbf3a44eabbff29f884beb157. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:12:13.883491 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:12:13.887381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:12:13.982164 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d3734c3a-3f27-41c4-ba30-a5e848c22684 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.106382 Aug 30 05:12:13.983324 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 6/14] 10.222.0.77 () {62 vars in 1188 bytes} [Tue Aug 30 05:12:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 05:12:13.995244 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2a5d6148-75dc-4877-9f2e-72f374603a2d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:13.996414 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2a5d6148-75dc-4877-9f2e-72f374603a2d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:14.017347 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8f3dde46-edcf-4ac0-97c4-d3e76856c828 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:14.018401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8f3dde46-edcf-4ac0-97c4-d3e76856c828 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:14.031530 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f3dde46-edcf-4ac0-97c4-d3e76856c828 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:14.033478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f3dde46-edcf-4ac0-97c4-d3e76856c828 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:14.035788 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f3dde46-edcf-4ac0-97c4-d3e76856c828 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:14.036670 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f3dde46-edcf-4ac0-97c4-d3e76856c828 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:14.037271 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f3dde46-edcf-4ac0-97c4-d3e76856c828 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:14.039077 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8f3dde46-edcf-4ac0-97c4-d3e76856c828 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:14.155114 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2a5d6148-75dc-4877-9f2e-72f374603a2d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:14.166475 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2a5d6148-75dc-4877-9f2e-72f374603a2d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:14.174935 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2a5d6148-75dc-4877-9f2e-72f374603a2d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:14.177268 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2a5d6148-75dc-4877-9f2e-72f374603a2d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1281 microversion: 2.20 time: 0.186209 Aug 30 05:12:14.200844 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 9/15] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:13 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1281 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:14.272492 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-11a0ffcf-b518-433c-9a41-6057708b6415 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:14.274303 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-11a0ffcf-b518-433c-9a41-6057708b6415 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:14.284367 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11a0ffcf-b518-433c-9a41-6057708b6415 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:14.285793 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11a0ffcf-b518-433c-9a41-6057708b6415 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:14.287480 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11a0ffcf-b518-433c-9a41-6057708b6415 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:14.291861 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11a0ffcf-b518-433c-9a41-6057708b6415 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:14.300446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11a0ffcf-b518-433c-9a41-6057708b6415 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:14.302453 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-11a0ffcf-b518-433c-9a41-6057708b6415 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:14.406172 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-11a0ffcf-b518-433c-9a41-6057708b6415 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:14.419653 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-11a0ffcf-b518-433c-9a41-6057708b6415 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1225 microversion: 2.1 time: 0.152928 Aug 30 05:12:14.420447 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 10/16] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:14 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1225 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:14.461041 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8f3dde46-edcf-4ac0-97c4-d3e76856c828 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:14.489767 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8f3dde46-edcf-4ac0-97c4-d3e76856c828 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1273 microversion: 2.1 time: 0.476939 Aug 30 05:12:14.494134 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 7/17] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:14 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1273 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:14.520383 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aaea1ec6-2566-415d-a4d3-4725167da8cf tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:14.521209 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-aaea1ec6-2566-415d-a4d3-4725167da8cf tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:14.535461 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaea1ec6-2566-415d-a4d3-4725167da8cf tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:14.537183 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaea1ec6-2566-415d-a4d3-4725167da8cf tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:14.537796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaea1ec6-2566-415d-a4d3-4725167da8cf tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:14.538661 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaea1ec6-2566-415d-a4d3-4725167da8cf tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:14.540649 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaea1ec6-2566-415d-a4d3-4725167da8cf tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:14.541238 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaea1ec6-2566-415d-a4d3-4725167da8cf tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:14.674873 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aaea1ec6-2566-415d-a4d3-4725167da8cf tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:14.693104 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aaea1ec6-2566-415d-a4d3-4725167da8cf tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1240 microversion: 2.1 time: 0.178392 Aug 30 05:12:14.697336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 11/18] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:14 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1240 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:15.215194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-359fdb7d-b508-4959-abbc-006ee0f3e456 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:15.215937 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-359fdb7d-b508-4959-abbc-006ee0f3e456 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:15.261103 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-359fdb7d-b508-4959-abbc-006ee0f3e456 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:15.269867 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-359fdb7d-b508-4959-abbc-006ee0f3e456 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:15.270474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-359fdb7d-b508-4959-abbc-006ee0f3e456 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:15.277389 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-359fdb7d-b508-4959-abbc-006ee0f3e456 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:15.277939 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-359fdb7d-b508-4959-abbc-006ee0f3e456 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:15.279584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-359fdb7d-b508-4959-abbc-006ee0f3e456 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:15.396882 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-359fdb7d-b508-4959-abbc-006ee0f3e456 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:15.406732 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-359fdb7d-b508-4959-abbc-006ee0f3e456 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:15.408259 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-359fdb7d-b508-4959-abbc-006ee0f3e456 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:15.410144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-359fdb7d-b508-4959-abbc-006ee0f3e456 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1285 microversion: 2.20 time: 0.201435 Aug 30 05:12:15.410731 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 8/19] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:15 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:15.440534 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-798575a1-2d4d-4183-ad97-916b8bf2075d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:15.442606 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-798575a1-2d4d-4183-ad97-916b8bf2075d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:15.449109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-798575a1-2d4d-4183-ad97-916b8bf2075d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:15.449615 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-798575a1-2d4d-4183-ad97-916b8bf2075d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:15.450067 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-798575a1-2d4d-4183-ad97-916b8bf2075d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:15.450779 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-798575a1-2d4d-4183-ad97-916b8bf2075d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:15.451272 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-798575a1-2d4d-4183-ad97-916b8bf2075d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:15.451711 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-798575a1-2d4d-4183-ad97-916b8bf2075d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:15.518791 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-95cfc01f-45b2-4adb-9d0a-4493f0af7693 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:15.519701 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-95cfc01f-45b2-4adb-9d0a-4493f0af7693 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:15.531810 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95cfc01f-45b2-4adb-9d0a-4493f0af7693 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:15.533827 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95cfc01f-45b2-4adb-9d0a-4493f0af7693 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:15.534468 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95cfc01f-45b2-4adb-9d0a-4493f0af7693 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:15.535413 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-798575a1-2d4d-4183-ad97-916b8bf2075d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:15.536025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95cfc01f-45b2-4adb-9d0a-4493f0af7693 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:15.536584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95cfc01f-45b2-4adb-9d0a-4493f0af7693 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:15.537419 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-95cfc01f-45b2-4adb-9d0a-4493f0af7693 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:15.568224 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-798575a1-2d4d-4183-ad97-916b8bf2075d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1225 microversion: 2.1 time: 0.131950 Aug 30 05:12:15.568841 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 12/20] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:15 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:15.629679 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-95cfc01f-45b2-4adb-9d0a-4493f0af7693 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:15.638509 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-95cfc01f-45b2-4adb-9d0a-4493f0af7693 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1273 microversion: 2.1 time: 0.123484 Aug 30 05:12:15.639677 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 9/21] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:15 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:15.713465 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fc5df76b-4be0-4619-8f4c-00674e03884c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:15.714081 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fc5df76b-4be0-4619-8f4c-00674e03884c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:15.721256 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc5df76b-4be0-4619-8f4c-00674e03884c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:15.721956 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc5df76b-4be0-4619-8f4c-00674e03884c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:15.723094 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc5df76b-4be0-4619-8f4c-00674e03884c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:15.724056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc5df76b-4be0-4619-8f4c-00674e03884c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:15.724997 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc5df76b-4be0-4619-8f4c-00674e03884c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:15.725573 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fc5df76b-4be0-4619-8f4c-00674e03884c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:15.798884 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fc5df76b-4be0-4619-8f4c-00674e03884c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:15.809412 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fc5df76b-4be0-4619-8f4c-00674e03884c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1240 microversion: 2.1 time: 0.099603 Aug 30 05:12:15.824262 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 13/22] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:15 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1240 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:16.432928 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-96d5cde8-f5f2-49d1-a249-f5932971a966 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:16.433614 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-96d5cde8-f5f2-49d1-a249-f5932971a966 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:16.439931 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96d5cde8-f5f2-49d1-a249-f5932971a966 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:16.440489 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96d5cde8-f5f2-49d1-a249-f5932971a966 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:16.441056 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96d5cde8-f5f2-49d1-a249-f5932971a966 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:16.441830 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96d5cde8-f5f2-49d1-a249-f5932971a966 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:16.442353 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96d5cde8-f5f2-49d1-a249-f5932971a966 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:16.442928 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-96d5cde8-f5f2-49d1-a249-f5932971a966 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:16.560096 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-96d5cde8-f5f2-49d1-a249-f5932971a966 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:16.568449 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-96d5cde8-f5f2-49d1-a249-f5932971a966 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:16.570152 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-96d5cde8-f5f2-49d1-a249-f5932971a966 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:16.572386 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-96d5cde8-f5f2-49d1-a249-f5932971a966 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1285 microversion: 2.20 time: 0.143476 Aug 30 05:12:16.573340 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 10/23] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:16 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:12:16.589712 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b43f2f66-c230-4853-9cc8-c82206f2bf2f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:16.590309 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b43f2f66-c230-4853-9cc8-c82206f2bf2f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:16.605335 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b43f2f66-c230-4853-9cc8-c82206f2bf2f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:16.606186 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b43f2f66-c230-4853-9cc8-c82206f2bf2f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:16.606792 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b43f2f66-c230-4853-9cc8-c82206f2bf2f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:16.607791 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b43f2f66-c230-4853-9cc8-c82206f2bf2f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:16.608225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b43f2f66-c230-4853-9cc8-c82206f2bf2f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:16.608769 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b43f2f66-c230-4853-9cc8-c82206f2bf2f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:16.665092 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3117302f-0801-4724-ac0a-7ef29ca02087 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:16.665715 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3117302f-0801-4724-ac0a-7ef29ca02087 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:16.687580 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3117302f-0801-4724-ac0a-7ef29ca02087 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:16.698682 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3117302f-0801-4724-ac0a-7ef29ca02087 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:16.699347 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3117302f-0801-4724-ac0a-7ef29ca02087 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:16.700142 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3117302f-0801-4724-ac0a-7ef29ca02087 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:16.700590 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3117302f-0801-4724-ac0a-7ef29ca02087 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:16.701152 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3117302f-0801-4724-ac0a-7ef29ca02087 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:16.704853 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b43f2f66-c230-4853-9cc8-c82206f2bf2f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:16.714290 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b43f2f66-c230-4853-9cc8-c82206f2bf2f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1225 microversion: 2.1 time: 0.128278 Aug 30 05:12:16.728428 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 14/24] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:16 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1225 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:16.809257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3117302f-0801-4724-ac0a-7ef29ca02087 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:16.818114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3117302f-0801-4724-ac0a-7ef29ca02087 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1273 microversion: 2.1 time: 0.162058 Aug 30 05:12:16.819772 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 11/25] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:16 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:16.833562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9f47e4dc-7f2b-4fbb-a310-95298cc70bc1 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:16.834533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9f47e4dc-7f2b-4fbb-a310-95298cc70bc1 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:16.842248 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f47e4dc-7f2b-4fbb-a310-95298cc70bc1 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:16.848860 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f47e4dc-7f2b-4fbb-a310-95298cc70bc1 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:16.849460 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f47e4dc-7f2b-4fbb-a310-95298cc70bc1 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:16.850295 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f47e4dc-7f2b-4fbb-a310-95298cc70bc1 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:16.850984 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f47e4dc-7f2b-4fbb-a310-95298cc70bc1 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:16.852966 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f47e4dc-7f2b-4fbb-a310-95298cc70bc1 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:16.942732 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9f47e4dc-7f2b-4fbb-a310-95298cc70bc1 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:16.955791 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9f47e4dc-7f2b-4fbb-a310-95298cc70bc1 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1240 microversion: 2.1 time: 0.127774 Aug 30 05:12:16.957359 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 15/26] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:16 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1240 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:17.601640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-58308838-af09-4a79-9aa1-6679b6806e67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:17.604193 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-58308838-af09-4a79-9aa1-6679b6806e67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:17.612440 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58308838-af09-4a79-9aa1-6679b6806e67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:17.613632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58308838-af09-4a79-9aa1-6679b6806e67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:17.614261 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58308838-af09-4a79-9aa1-6679b6806e67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:17.615010 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58308838-af09-4a79-9aa1-6679b6806e67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:17.615616 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58308838-af09-4a79-9aa1-6679b6806e67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:17.616261 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-58308838-af09-4a79-9aa1-6679b6806e67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:17.701328 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-58308838-af09-4a79-9aa1-6679b6806e67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:17.710683 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-58308838-af09-4a79-9aa1-6679b6806e67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:17.713894 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-58308838-af09-4a79-9aa1-6679b6806e67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:17.715084 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-58308838-af09-4a79-9aa1-6679b6806e67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1285 microversion: 2.20 time: 0.123674 Aug 30 05:12:17.716057 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 12/27] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:17 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:17.741576 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-25113a8f-4de4-4933-9d1c-9321b25246fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:17.743616 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-25113a8f-4de4-4933-9d1c-9321b25246fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:17.760037 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25113a8f-4de4-4933-9d1c-9321b25246fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:17.760428 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25113a8f-4de4-4933-9d1c-9321b25246fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:17.760875 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25113a8f-4de4-4933-9d1c-9321b25246fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:17.761592 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25113a8f-4de4-4933-9d1c-9321b25246fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:17.762537 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25113a8f-4de4-4933-9d1c-9321b25246fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:17.766638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25113a8f-4de4-4933-9d1c-9321b25246fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:17.840846 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9c15c0e7-9cb0-490f-a2d5-ad03a71f7c69 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:17.841760 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9c15c0e7-9cb0-490f-a2d5-ad03a71f7c69 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:17.848604 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c15c0e7-9cb0-490f-a2d5-ad03a71f7c69 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:17.849367 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c15c0e7-9cb0-490f-a2d5-ad03a71f7c69 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:17.850136 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c15c0e7-9cb0-490f-a2d5-ad03a71f7c69 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:17.851060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c15c0e7-9cb0-490f-a2d5-ad03a71f7c69 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:17.851703 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c15c0e7-9cb0-490f-a2d5-ad03a71f7c69 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:17.852314 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9c15c0e7-9cb0-490f-a2d5-ad03a71f7c69 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:17.863121 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-25113a8f-4de4-4933-9d1c-9321b25246fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:17.882006 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-25113a8f-4de4-4933-9d1c-9321b25246fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1225 microversion: 2.1 time: 0.149092 Aug 30 05:12:17.883966 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 16/28] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:17 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1225 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:17.957435 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9c15c0e7-9cb0-490f-a2d5-ad03a71f7c69 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:17.966604 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9c15c0e7-9cb0-490f-a2d5-ad03a71f7c69 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1273 microversion: 2.1 time: 0.130159 Aug 30 05:12:17.967245 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 13/29] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:17 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1273 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:17.981682 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c5ad7c53-cf5d-49ad-a51b-332bfef95c11 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:17.982762 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c5ad7c53-cf5d-49ad-a51b-332bfef95c11 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:17.995175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5ad7c53-cf5d-49ad-a51b-332bfef95c11 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:17.996625 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5ad7c53-cf5d-49ad-a51b-332bfef95c11 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:17.997450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5ad7c53-cf5d-49ad-a51b-332bfef95c11 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:17.999853 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5ad7c53-cf5d-49ad-a51b-332bfef95c11 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:18.001762 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5ad7c53-cf5d-49ad-a51b-332bfef95c11 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:18.003257 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5ad7c53-cf5d-49ad-a51b-332bfef95c11 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:18.119418 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c5ad7c53-cf5d-49ad-a51b-332bfef95c11 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:18.139117 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c5ad7c53-cf5d-49ad-a51b-332bfef95c11 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1240 microversion: 2.1 time: 0.164829 Aug 30 05:12:18.140220 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 17/30] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:17 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1240 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:18.748663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8d9d35a6-ab4a-4897-84d4-2c383b22508a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:18.750472 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8d9d35a6-ab4a-4897-84d4-2c383b22508a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:18.768712 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d9d35a6-ab4a-4897-84d4-2c383b22508a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:18.769447 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d9d35a6-ab4a-4897-84d4-2c383b22508a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:18.769753 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d9d35a6-ab4a-4897-84d4-2c383b22508a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:18.770482 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d9d35a6-ab4a-4897-84d4-2c383b22508a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:18.776001 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d9d35a6-ab4a-4897-84d4-2c383b22508a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:18.776552 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d9d35a6-ab4a-4897-84d4-2c383b22508a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:18.913030 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-17461ffc-12ff-4133-b92c-46d47141e7b1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:18.914402 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-17461ffc-12ff-4133-b92c-46d47141e7b1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:18.926409 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17461ffc-12ff-4133-b92c-46d47141e7b1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:18.928226 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17461ffc-12ff-4133-b92c-46d47141e7b1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:18.930737 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17461ffc-12ff-4133-b92c-46d47141e7b1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:18.933304 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17461ffc-12ff-4133-b92c-46d47141e7b1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:18.933857 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17461ffc-12ff-4133-b92c-46d47141e7b1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:18.935950 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17461ffc-12ff-4133-b92c-46d47141e7b1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:18.983460 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8d9d35a6-ab4a-4897-84d4-2c383b22508a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:18.983460 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8d9d35a6-ab4a-4897-84d4-2c383b22508a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:18.983685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8d9d35a6-ab4a-4897-84d4-2c383b22508a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:18.995852 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8d9d35a6-ab4a-4897-84d4-2c383b22508a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1285 microversion: 2.20 time: 0.244911 Aug 30 05:12:19.000391 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 14/31] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:18 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1285 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:19.014994 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-973c291c-0e71-4b13-8924-52e560592801 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:19.016002 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-973c291c-0e71-4b13-8924-52e560592801 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:19.028453 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-973c291c-0e71-4b13-8924-52e560592801 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:19.029374 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-973c291c-0e71-4b13-8924-52e560592801 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:19.030229 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-973c291c-0e71-4b13-8924-52e560592801 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:19.031499 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-973c291c-0e71-4b13-8924-52e560592801 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:19.032118 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-973c291c-0e71-4b13-8924-52e560592801 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:19.032698 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-973c291c-0e71-4b13-8924-52e560592801 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:19.120459 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-17461ffc-12ff-4133-b92c-46d47141e7b1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:19.128967 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-17461ffc-12ff-4133-b92c-46d47141e7b1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1225 microversion: 2.1 time: 0.222221 Aug 30 05:12:19.129568 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 18/32] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:18 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1225 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:19.153934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-973c291c-0e71-4b13-8924-52e560592801 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:19.161980 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7bebbac6-a040-41ea-bf1d-214998ffc681 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:19.162620 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7bebbac6-a040-41ea-bf1d-214998ffc681 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:19.174595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-973c291c-0e71-4b13-8924-52e560592801 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1273 microversion: 2.1 time: 0.170359 Aug 30 05:12:19.177505 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 15/33] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:19 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:19.180054 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bebbac6-a040-41ea-bf1d-214998ffc681 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:19.180908 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bebbac6-a040-41ea-bf1d-214998ffc681 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:19.181537 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bebbac6-a040-41ea-bf1d-214998ffc681 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:19.183080 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bebbac6-a040-41ea-bf1d-214998ffc681 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:19.183856 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bebbac6-a040-41ea-bf1d-214998ffc681 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:19.184426 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7bebbac6-a040-41ea-bf1d-214998ffc681 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:19.381894 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7bebbac6-a040-41ea-bf1d-214998ffc681 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:19.395997 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7bebbac6-a040-41ea-bf1d-214998ffc681 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1240 microversion: 2.1 time: 0.238524 Aug 30 05:12:19.396872 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 19/34] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:19 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1240 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:20.037531 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6cd9ae4e-3918-484a-9c6d-a56f04bf3973 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:20.038457 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6cd9ae4e-3918-484a-9c6d-a56f04bf3973 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:20.065040 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cd9ae4e-3918-484a-9c6d-a56f04bf3973 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:20.074951 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cd9ae4e-3918-484a-9c6d-a56f04bf3973 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:20.077382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cd9ae4e-3918-484a-9c6d-a56f04bf3973 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:20.080193 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cd9ae4e-3918-484a-9c6d-a56f04bf3973 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:20.080694 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cd9ae4e-3918-484a-9c6d-a56f04bf3973 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:20.083395 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cd9ae4e-3918-484a-9c6d-a56f04bf3973 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:20.154172 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cddb9102-42dc-4b49-befc-2ff79a1b4282 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:20.155583 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cddb9102-42dc-4b49-befc-2ff79a1b4282 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:20.156818 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6cd9ae4e-3918-484a-9c6d-a56f04bf3973 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:20.162797 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cddb9102-42dc-4b49-befc-2ff79a1b4282 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:20.165032 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cddb9102-42dc-4b49-befc-2ff79a1b4282 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:20.165853 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6cd9ae4e-3918-484a-9c6d-a56f04bf3973 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:20.166070 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cddb9102-42dc-4b49-befc-2ff79a1b4282 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:20.166793 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cddb9102-42dc-4b49-befc-2ff79a1b4282 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:20.167278 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cddb9102-42dc-4b49-befc-2ff79a1b4282 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:20.167409 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6cd9ae4e-3918-484a-9c6d-a56f04bf3973 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:20.167707 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cddb9102-42dc-4b49-befc-2ff79a1b4282 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:20.168438 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6cd9ae4e-3918-484a-9c6d-a56f04bf3973 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1285 microversion: 2.20 time: 0.136375 Aug 30 05:12:20.168998 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 16/35] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:20 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:20.198887 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6fa5f402-1583-4e55-9e10-844e5161a385 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:20.199798 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6fa5f402-1583-4e55-9e10-844e5161a385 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:20.205911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6fa5f402-1583-4e55-9e10-844e5161a385 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:20.207272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6fa5f402-1583-4e55-9e10-844e5161a385 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:20.207724 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6fa5f402-1583-4e55-9e10-844e5161a385 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:20.208563 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6fa5f402-1583-4e55-9e10-844e5161a385 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:20.209022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6fa5f402-1583-4e55-9e10-844e5161a385 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:20.209444 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6fa5f402-1583-4e55-9e10-844e5161a385 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:20.251666 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cddb9102-42dc-4b49-befc-2ff79a1b4282 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:20.262129 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cddb9102-42dc-4b49-befc-2ff79a1b4282 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1225 microversion: 2.1 time: 0.113727 Aug 30 05:12:20.263990 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 20/36] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:20 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:20.306061 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6fa5f402-1583-4e55-9e10-844e5161a385 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:20.315713 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6fa5f402-1583-4e55-9e10-844e5161a385 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1273 microversion: 2.1 time: 0.120830 Aug 30 05:12:20.316995 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 17/37] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:20 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1273 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:20.422490 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bb5ec007-8c99-4abc-91d8-ef8d738c4418 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:20.423468 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bb5ec007-8c99-4abc-91d8-ef8d738c4418 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:20.434518 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb5ec007-8c99-4abc-91d8-ef8d738c4418 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:20.435348 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb5ec007-8c99-4abc-91d8-ef8d738c4418 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:20.435994 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb5ec007-8c99-4abc-91d8-ef8d738c4418 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:20.436983 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb5ec007-8c99-4abc-91d8-ef8d738c4418 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:20.437630 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb5ec007-8c99-4abc-91d8-ef8d738c4418 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:20.438242 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bb5ec007-8c99-4abc-91d8-ef8d738c4418 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:20.529957 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bb5ec007-8c99-4abc-91d8-ef8d738c4418 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:20.531752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bb5ec007-8c99-4abc-91d8-ef8d738c4418 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1240 microversion: 2.1 time: 0.114254 Aug 30 05:12:20.532793 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 21/38] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:20 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1240 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:21.193234 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c951f474-970a-4b6c-8aff-169103a8cf3b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:21.193887 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c951f474-970a-4b6c-8aff-169103a8cf3b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:21.201102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c951f474-970a-4b6c-8aff-169103a8cf3b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:21.201102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c951f474-970a-4b6c-8aff-169103a8cf3b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:21.201309 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c951f474-970a-4b6c-8aff-169103a8cf3b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:21.201937 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c951f474-970a-4b6c-8aff-169103a8cf3b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:21.202400 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c951f474-970a-4b6c-8aff-169103a8cf3b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:21.203235 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c951f474-970a-4b6c-8aff-169103a8cf3b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:21.289846 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c951f474-970a-4b6c-8aff-169103a8cf3b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:21.293844 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-758287d4-4814-419a-8280-dd33d5514e46 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:21.294400 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-758287d4-4814-419a-8280-dd33d5514e46 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:21.302207 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c951f474-970a-4b6c-8aff-169103a8cf3b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:21.308364 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:21.312471 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-758287d4-4814-419a-8280-dd33d5514e46 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:21.312991 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-758287d4-4814-419a-8280-dd33d5514e46 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:21.313453 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-758287d4-4814-419a-8280-dd33d5514e46 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:21.314188 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-758287d4-4814-419a-8280-dd33d5514e46 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:21.314654 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-758287d4-4814-419a-8280-dd33d5514e46 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:21.315175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-758287d4-4814-419a-8280-dd33d5514e46 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:21.318621 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c951f474-970a-4b6c-8aff-169103a8cf3b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:21.319830 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c951f474-970a-4b6c-8aff-169103a8cf3b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1285 microversion: 2.20 time: 0.132946 Aug 30 05:12:21.320385 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 18/39] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:21 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:21.339115 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-665be429-3613-4251-af4e-6c8619471e39 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:21.339991 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-665be429-3613-4251-af4e-6c8619471e39 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:21.357293 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-665be429-3613-4251-af4e-6c8619471e39 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:21.358910 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-665be429-3613-4251-af4e-6c8619471e39 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:21.359506 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-665be429-3613-4251-af4e-6c8619471e39 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:21.363860 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-665be429-3613-4251-af4e-6c8619471e39 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:21.365196 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-665be429-3613-4251-af4e-6c8619471e39 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:21.365814 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-665be429-3613-4251-af4e-6c8619471e39 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:21.408980 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-758287d4-4814-419a-8280-dd33d5514e46 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:21.418097 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-758287d4-4814-419a-8280-dd33d5514e46 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1225 microversion: 2.1 time: 0.139450 Aug 30 05:12:21.419212 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 22/40] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:21 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1225 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:21.467670 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-665be429-3613-4251-af4e-6c8619471e39 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:21.479368 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-665be429-3613-4251-af4e-6c8619471e39 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1273 microversion: 2.1 time: 0.145332 Aug 30 05:12:21.482619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 19/41] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:21 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:21.554782 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ccc10dd8-7d5c-47fe-badc-33398a5f3417 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:21.555805 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ccc10dd8-7d5c-47fe-badc-33398a5f3417 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:21.568098 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ccc10dd8-7d5c-47fe-badc-33398a5f3417 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:21.569060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ccc10dd8-7d5c-47fe-badc-33398a5f3417 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:21.570103 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ccc10dd8-7d5c-47fe-badc-33398a5f3417 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:21.571336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ccc10dd8-7d5c-47fe-badc-33398a5f3417 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:21.572035 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ccc10dd8-7d5c-47fe-badc-33398a5f3417 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:21.572667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ccc10dd8-7d5c-47fe-badc-33398a5f3417 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:21.675378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ccc10dd8-7d5c-47fe-badc-33398a5f3417 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:21.678984 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:21.690031 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ccc10dd8-7d5c-47fe-badc-33398a5f3417 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1240 microversion: 2.1 time: 0.140060 Aug 30 05:12:21.702128 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 23/42] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:21 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1240 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:22.346244 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5a345e75-369d-449a-abcd-debcc2cc1dfa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:22.347581 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5a345e75-369d-449a-abcd-debcc2cc1dfa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:22.355609 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a345e75-369d-449a-abcd-debcc2cc1dfa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:22.356318 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a345e75-369d-449a-abcd-debcc2cc1dfa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:22.356946 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a345e75-369d-449a-abcd-debcc2cc1dfa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:22.358496 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a345e75-369d-449a-abcd-debcc2cc1dfa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:22.359238 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a345e75-369d-449a-abcd-debcc2cc1dfa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:22.359832 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5a345e75-369d-449a-abcd-debcc2cc1dfa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:22.441064 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2ad0cb28-5d5a-4c70-b3ba-8c003b4b73ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:22.441738 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5a345e75-369d-449a-abcd-debcc2cc1dfa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:22.443067 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2ad0cb28-5d5a-4c70-b3ba-8c003b4b73ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:22.450323 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5a345e75-369d-449a-abcd-debcc2cc1dfa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:22.451240 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=4 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:22.451828 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5a345e75-369d-449a-abcd-debcc2cc1dfa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:22.454745 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ad0cb28-5d5a-4c70-b3ba-8c003b4b73ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:22.455512 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ad0cb28-5d5a-4c70-b3ba-8c003b4b73ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:22.456630 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ad0cb28-5d5a-4c70-b3ba-8c003b4b73ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:22.457669 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ad0cb28-5d5a-4c70-b3ba-8c003b4b73ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:22.458307 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ad0cb28-5d5a-4c70-b3ba-8c003b4b73ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:22.462152 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ad0cb28-5d5a-4c70-b3ba-8c003b4b73ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:22.468084 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5a345e75-369d-449a-abcd-debcc2cc1dfa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1285 microversion: 2.20 time: 0.126451 Aug 30 05:12:22.468692 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 20/43] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:22 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:22.501480 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3b6c7e63-df28-43df-acd1-5619791a66bd tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:22.502578 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3b6c7e63-df28-43df-acd1-5619791a66bd tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:22.521265 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b6c7e63-df28-43df-acd1-5619791a66bd tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:22.522076 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b6c7e63-df28-43df-acd1-5619791a66bd tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:22.523169 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b6c7e63-df28-43df-acd1-5619791a66bd tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:22.525460 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b6c7e63-df28-43df-acd1-5619791a66bd tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:22.533060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b6c7e63-df28-43df-acd1-5619791a66bd tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:22.533793 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b6c7e63-df28-43df-acd1-5619791a66bd tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:22.556876 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2ad0cb28-5d5a-4c70-b3ba-8c003b4b73ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:22.569076 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2ad0cb28-5d5a-4c70-b3ba-8c003b4b73ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1225 microversion: 2.1 time: 0.130753 Aug 30 05:12:22.581992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 24/44] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:22 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:22.646219 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3b6c7e63-df28-43df-acd1-5619791a66bd tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:22.659377 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3b6c7e63-df28-43df-acd1-5619791a66bd tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1273 microversion: 2.1 time: 0.162137 Aug 30 05:12:22.660838 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 21/45] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:22 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1273 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:22.723514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-04612f34-c091-4823-9b4a-8fbefaa5727d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:22.724296 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-04612f34-c091-4823-9b4a-8fbefaa5727d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:22.747497 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04612f34-c091-4823-9b4a-8fbefaa5727d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:22.748782 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04612f34-c091-4823-9b4a-8fbefaa5727d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:22.749376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04612f34-c091-4823-9b4a-8fbefaa5727d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:22.750308 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04612f34-c091-4823-9b4a-8fbefaa5727d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:22.751091 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04612f34-c091-4823-9b4a-8fbefaa5727d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:22.751765 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04612f34-c091-4823-9b4a-8fbefaa5727d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:22.837424 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-04612f34-c091-4823-9b4a-8fbefaa5727d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:22.851519 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-04612f34-c091-4823-9b4a-8fbefaa5727d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1240 microversion: 2.1 time: 0.132244 Aug 30 05:12:22.853586 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 25/46] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:22 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1240 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:23.493006 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1dabb8b0-bb90-41cc-a8c3-f8a7b662c320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:23.493649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1dabb8b0-bb90-41cc-a8c3-f8a7b662c320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:23.502268 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1dabb8b0-bb90-41cc-a8c3-f8a7b662c320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:23.502755 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1dabb8b0-bb90-41cc-a8c3-f8a7b662c320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:23.509296 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1dabb8b0-bb90-41cc-a8c3-f8a7b662c320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:23.510057 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1dabb8b0-bb90-41cc-a8c3-f8a7b662c320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:23.510536 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1dabb8b0-bb90-41cc-a8c3-f8a7b662c320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:23.511710 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1dabb8b0-bb90-41cc-a8c3-f8a7b662c320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:23.537577 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:23.590636 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fb88277f-e128-41e4-bbb1-5fdd80269922 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:23.592203 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fb88277f-e128-41e4-bbb1-5fdd80269922 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:23.600280 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb88277f-e128-41e4-bbb1-5fdd80269922 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:23.601067 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb88277f-e128-41e4-bbb1-5fdd80269922 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:23.602173 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb88277f-e128-41e4-bbb1-5fdd80269922 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:23.603134 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb88277f-e128-41e4-bbb1-5fdd80269922 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:23.603802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb88277f-e128-41e4-bbb1-5fdd80269922 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:23.604486 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb88277f-e128-41e4-bbb1-5fdd80269922 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:23.618083 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1dabb8b0-bb90-41cc-a8c3-f8a7b662c320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:23.637544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1dabb8b0-bb90-41cc-a8c3-f8a7b662c320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:23.639319 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1dabb8b0-bb90-41cc-a8c3-f8a7b662c320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:23.640683 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1dabb8b0-bb90-41cc-a8c3-f8a7b662c320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1285 microversion: 2.20 time: 0.152365 Aug 30 05:12:23.641387 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 22/47] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:23 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:12:23.688549 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fb88277f-e128-41e4-bbb1-5fdd80269922 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:23.698597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fb88277f-e128-41e4-bbb1-5fdd80269922 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1225 microversion: 2.1 time: 0.111084 Aug 30 05:12:23.704909 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-14c0d7a3-fea2-4682-a064-168976b4890a tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:23.705839 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-14c0d7a3-fea2-4682-a064-168976b4890a tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:23.711730 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 26/48] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:23 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:23.713240 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14c0d7a3-fea2-4682-a064-168976b4890a tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:23.713954 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14c0d7a3-fea2-4682-a064-168976b4890a tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:23.714767 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14c0d7a3-fea2-4682-a064-168976b4890a tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:23.715869 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14c0d7a3-fea2-4682-a064-168976b4890a tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:23.716434 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14c0d7a3-fea2-4682-a064-168976b4890a tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:23.717012 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14c0d7a3-fea2-4682-a064-168976b4890a tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:23.830628 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:23.847977 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-14c0d7a3-fea2-4682-a064-168976b4890a tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:23.857233 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-14c0d7a3-fea2-4682-a064-168976b4890a tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1273 microversion: 2.1 time: 0.167157 Aug 30 05:12:23.858858 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 23/49] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:23 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1273 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:23.875716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ea52fb44-fd69-44dc-be09-51465370caf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:23.884661 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ea52fb44-fd69-44dc-be09-51465370caf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:23.895538 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea52fb44-fd69-44dc-be09-51465370caf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:23.896341 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea52fb44-fd69-44dc-be09-51465370caf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:23.896962 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea52fb44-fd69-44dc-be09-51465370caf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:23.897849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea52fb44-fd69-44dc-be09-51465370caf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:23.898473 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea52fb44-fd69-44dc-be09-51465370caf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:23.899100 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ea52fb44-fd69-44dc-be09-51465370caf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:23.964522 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ea52fb44-fd69-44dc-be09-51465370caf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:23.975589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ea52fb44-fd69-44dc-be09-51465370caf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1240 microversion: 2.1 time: 0.103252 Aug 30 05:12:23.976892 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 27/50] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:23 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1240 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:24.664051 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8bacd7cc-8872-4bbd-9987-0a5a37634d46 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:24.664752 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8bacd7cc-8872-4bbd-9987-0a5a37634d46 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:24.666769 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=24 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:24.672814 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bacd7cc-8872-4bbd-9987-0a5a37634d46 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:24.673372 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bacd7cc-8872-4bbd-9987-0a5a37634d46 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:24.673876 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bacd7cc-8872-4bbd-9987-0a5a37634d46 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:24.674652 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bacd7cc-8872-4bbd-9987-0a5a37634d46 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:24.675903 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bacd7cc-8872-4bbd-9987-0a5a37634d46 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:24.676399 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8bacd7cc-8872-4bbd-9987-0a5a37634d46 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:24.721814 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0cfc7366-e456-45c1-aae7-fb2a3c924f76 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:24.723019 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0cfc7366-e456-45c1-aae7-fb2a3c924f76 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:24.725189 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=26 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:24.731261 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cfc7366-e456-45c1-aae7-fb2a3c924f76 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:24.732002 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cfc7366-e456-45c1-aae7-fb2a3c924f76 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:24.732505 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cfc7366-e456-45c1-aae7-fb2a3c924f76 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:24.733279 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cfc7366-e456-45c1-aae7-fb2a3c924f76 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:24.733838 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cfc7366-e456-45c1-aae7-fb2a3c924f76 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:24.734343 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0cfc7366-e456-45c1-aae7-fb2a3c924f76 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:24.740765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8bacd7cc-8872-4bbd-9987-0a5a37634d46 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:24.749112 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8bacd7cc-8872-4bbd-9987-0a5a37634d46 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:24.750706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8bacd7cc-8872-4bbd-9987-0a5a37634d46 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:24.752125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8bacd7cc-8872-4bbd-9987-0a5a37634d46 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1285 microversion: 2.20 time: 0.092308 Aug 30 05:12:24.752849 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 24/51] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:24 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:24.805373 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0cfc7366-e456-45c1-aae7-fb2a3c924f76 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:24.813398 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0cfc7366-e456-45c1-aae7-fb2a3c924f76 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1225 microversion: 2.1 time: 0.095522 Aug 30 05:12:24.814104 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 28/52] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:24 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:24.880155 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-11b56eae-f597-4a83-bfa5-6d8b1b537a40 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:24.880934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-11b56eae-f597-4a83-bfa5-6d8b1b537a40 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:24.884158 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:24.887906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11b56eae-f597-4a83-bfa5-6d8b1b537a40 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:24.888390 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11b56eae-f597-4a83-bfa5-6d8b1b537a40 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:24.888821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11b56eae-f597-4a83-bfa5-6d8b1b537a40 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:24.889512 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11b56eae-f597-4a83-bfa5-6d8b1b537a40 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:24.889962 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11b56eae-f597-4a83-bfa5-6d8b1b537a40 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:24.890654 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-11b56eae-f597-4a83-bfa5-6d8b1b537a40 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:24.953981 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-11b56eae-f597-4a83-bfa5-6d8b1b537a40 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:24.961984 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-11b56eae-f597-4a83-bfa5-6d8b1b537a40 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1273 microversion: 2.1 time: 0.086150 Aug 30 05:12:24.962667 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 25/53] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:24 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:24.996800 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c1893fdf-fdb5-40d3-ae77-0b328206911b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:24.997650 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c1893fdf-fdb5-40d3-ae77-0b328206911b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:25.003932 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1893fdf-fdb5-40d3-ae77-0b328206911b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:25.004421 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1893fdf-fdb5-40d3-ae77-0b328206911b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:25.004858 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1893fdf-fdb5-40d3-ae77-0b328206911b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:25.005587 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1893fdf-fdb5-40d3-ae77-0b328206911b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:25.006046 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1893fdf-fdb5-40d3-ae77-0b328206911b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:25.006478 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c1893fdf-fdb5-40d3-ae77-0b328206911b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:25.067948 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c1893fdf-fdb5-40d3-ae77-0b328206911b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:25.075883 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c1893fdf-fdb5-40d3-ae77-0b328206911b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1240 microversion: 2.1 time: 0.083200 Aug 30 05:12:25.076482 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 29/54] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:24 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:25.775434 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-86ed3f9a-da34-4366-886d-9fc54d293d6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:25.776051 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-86ed3f9a-da34-4366-886d-9fc54d293d6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:25.781916 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86ed3f9a-da34-4366-886d-9fc54d293d6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:25.782399 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86ed3f9a-da34-4366-886d-9fc54d293d6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:25.782856 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86ed3f9a-da34-4366-886d-9fc54d293d6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:25.783546 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86ed3f9a-da34-4366-886d-9fc54d293d6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:25.784179 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86ed3f9a-da34-4366-886d-9fc54d293d6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:25.784611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86ed3f9a-da34-4366-886d-9fc54d293d6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:25.836624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-776e12d0-a0c2-43cf-b197-a3223f7ded39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:25.837493 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-776e12d0-a0c2-43cf-b197-a3223f7ded39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:25.855504 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-776e12d0-a0c2-43cf-b197-a3223f7ded39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:25.857638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-776e12d0-a0c2-43cf-b197-a3223f7ded39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:25.859584 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-776e12d0-a0c2-43cf-b197-a3223f7ded39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:25.862136 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-776e12d0-a0c2-43cf-b197-a3223f7ded39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:25.864965 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-776e12d0-a0c2-43cf-b197-a3223f7ded39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:25.867020 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-776e12d0-a0c2-43cf-b197-a3223f7ded39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:25.911263 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-86ed3f9a-da34-4366-886d-9fc54d293d6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:25.924818 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-86ed3f9a-da34-4366-886d-9fc54d293d6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:25.929752 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-86ed3f9a-da34-4366-886d-9fc54d293d6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:25.932813 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-86ed3f9a-da34-4366-886d-9fc54d293d6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1285 microversion: 2.20 time: 0.161302 Aug 30 05:12:25.935855 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 26/55] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:25 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:12:25.985827 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b414b03f-7b13-4a6f-8cf0-41e582333861 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:25.986474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b414b03f-7b13-4a6f-8cf0-41e582333861 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:25.998729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b414b03f-7b13-4a6f-8cf0-41e582333861 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:26.008618 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b414b03f-7b13-4a6f-8cf0-41e582333861 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:26.009801 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b414b03f-7b13-4a6f-8cf0-41e582333861 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:26.010544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b414b03f-7b13-4a6f-8cf0-41e582333861 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:26.011059 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b414b03f-7b13-4a6f-8cf0-41e582333861 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:26.011491 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b414b03f-7b13-4a6f-8cf0-41e582333861 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:26.150076 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b414b03f-7b13-4a6f-8cf0-41e582333861 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:26.162424 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-776e12d0-a0c2-43cf-b197-a3223f7ded39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:26.170359 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b414b03f-7b13-4a6f-8cf0-41e582333861 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1273 microversion: 2.1 time: 0.178365 Aug 30 05:12:26.172108 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-776e12d0-a0c2-43cf-b197-a3223f7ded39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1225 microversion: 2.1 time: 0.342043 Aug 30 05:12:26.173520 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 27/56] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:25 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:26.175710 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 30/57] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:25 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1225 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:26.179799 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7d189fc0-204a-4535-8f1b-27cd6625787e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:26.180563 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7d189fc0-204a-4535-8f1b-27cd6625787e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:26.197719 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d189fc0-204a-4535-8f1b-27cd6625787e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:26.199767 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d189fc0-204a-4535-8f1b-27cd6625787e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:26.200253 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d189fc0-204a-4535-8f1b-27cd6625787e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:26.200978 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d189fc0-204a-4535-8f1b-27cd6625787e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:26.201438 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d189fc0-204a-4535-8f1b-27cd6625787e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:26.201936 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7d189fc0-204a-4535-8f1b-27cd6625787e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:26.338609 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7d189fc0-204a-4535-8f1b-27cd6625787e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:26.350594 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7d189fc0-204a-4535-8f1b-27cd6625787e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1288 microversion: 2.1 time: 0.174530 Aug 30 05:12:26.351413 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 28/58] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:26 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1288 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:26.958231 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1be8974f-08b2-46a4-a647-fdc467600a67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:26.959029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1be8974f-08b2-46a4-a647-fdc467600a67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:26.965393 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1be8974f-08b2-46a4-a647-fdc467600a67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:26.966035 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1be8974f-08b2-46a4-a647-fdc467600a67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:26.966565 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1be8974f-08b2-46a4-a647-fdc467600a67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:26.967494 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1be8974f-08b2-46a4-a647-fdc467600a67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:26.968097 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1be8974f-08b2-46a4-a647-fdc467600a67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:26.968632 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1be8974f-08b2-46a4-a647-fdc467600a67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:27.034219 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1be8974f-08b2-46a4-a647-fdc467600a67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:27.044126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1be8974f-08b2-46a4-a647-fdc467600a67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:27.045836 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1be8974f-08b2-46a4-a647-fdc467600a67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:27.047975 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1be8974f-08b2-46a4-a647-fdc467600a67 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1333 microversion: 2.20 time: 0.094204 Aug 30 05:12:27.048777 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 31/59] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:26 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:27.200435 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c3988490-29bc-4411-9399-6a7bb6e86340 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:27.201070 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c3988490-29bc-4411-9399-6a7bb6e86340 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:27.201660 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4b0f7f8c-978b-4702-8069-b673b0ca0c6e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:27.203150 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4b0f7f8c-978b-4702-8069-b673b0ca0c6e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:27.217640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b0f7f8c-978b-4702-8069-b673b0ca0c6e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:27.218625 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b0f7f8c-978b-4702-8069-b673b0ca0c6e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:27.218625 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b0f7f8c-978b-4702-8069-b673b0ca0c6e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:27.219312 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b0f7f8c-978b-4702-8069-b673b0ca0c6e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:27.220020 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b0f7f8c-978b-4702-8069-b673b0ca0c6e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:27.220446 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4b0f7f8c-978b-4702-8069-b673b0ca0c6e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:27.226103 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3988490-29bc-4411-9399-6a7bb6e86340 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:27.226604 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3988490-29bc-4411-9399-6a7bb6e86340 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:27.227217 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3988490-29bc-4411-9399-6a7bb6e86340 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:27.228071 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3988490-29bc-4411-9399-6a7bb6e86340 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:27.228533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3988490-29bc-4411-9399-6a7bb6e86340 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:27.228959 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c3988490-29bc-4411-9399-6a7bb6e86340 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:27.290517 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4b0f7f8c-978b-4702-8069-b673b0ca0c6e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:27.299190 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4b0f7f8c-978b-4702-8069-b673b0ca0c6e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1217 microversion: 2.1 time: 0.109571 Aug 30 05:12:27.300502 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 29/60] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:27 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1217 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:27.373102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a82c52da-541b-4ba9-80da-6eeeeccbbee9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:27.373720 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a82c52da-541b-4ba9-80da-6eeeeccbbee9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:27.380404 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a82c52da-541b-4ba9-80da-6eeeeccbbee9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:27.380900 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a82c52da-541b-4ba9-80da-6eeeeccbbee9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:27.381331 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a82c52da-541b-4ba9-80da-6eeeeccbbee9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:27.382230 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a82c52da-541b-4ba9-80da-6eeeeccbbee9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:27.382473 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a82c52da-541b-4ba9-80da-6eeeeccbbee9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:27.382924 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a82c52da-541b-4ba9-80da-6eeeeccbbee9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:27.395139 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c3988490-29bc-4411-9399-6a7bb6e86340 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:27.402708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c3988490-29bc-4411-9399-6a7bb6e86340 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.207600 Aug 30 05:12:27.403897 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 32/61] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:27 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:27.443866 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a82c52da-541b-4ba9-80da-6eeeeccbbee9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:27.451270 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a82c52da-541b-4ba9-80da-6eeeeccbbee9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1288 microversion: 2.1 time: 0.082008 Aug 30 05:12:27.451844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 30/62] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:27 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1288 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:28.070415 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fcb272b0-770a-4dda-967b-f09933c81dea tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:28.071050 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fcb272b0-770a-4dda-967b-f09933c81dea tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:28.076875 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcb272b0-770a-4dda-967b-f09933c81dea tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:28.077359 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcb272b0-770a-4dda-967b-f09933c81dea tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:28.077787 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcb272b0-770a-4dda-967b-f09933c81dea tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:28.078463 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcb272b0-770a-4dda-967b-f09933c81dea tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:28.078950 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcb272b0-770a-4dda-967b-f09933c81dea tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:28.079373 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fcb272b0-770a-4dda-967b-f09933c81dea tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:28.139879 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fcb272b0-770a-4dda-967b-f09933c81dea tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:28.148338 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fcb272b0-770a-4dda-967b-f09933c81dea tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:28.149779 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fcb272b0-770a-4dda-967b-f09933c81dea tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:28.150897 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fcb272b0-770a-4dda-967b-f09933c81dea tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1333 microversion: 2.20 time: 0.084298 Aug 30 05:12:28.151447 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 33/63] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:28 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1333 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:28.321042 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d5701703-8598-470a-be01-afc42f5fe5e4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:28.321621 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d5701703-8598-470a-be01-afc42f5fe5e4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:28.327737 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5701703-8598-470a-be01-afc42f5fe5e4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:28.328217 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5701703-8598-470a-be01-afc42f5fe5e4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:28.328651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5701703-8598-470a-be01-afc42f5fe5e4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:28.329332 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5701703-8598-470a-be01-afc42f5fe5e4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:28.329781 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5701703-8598-470a-be01-afc42f5fe5e4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:28.330227 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d5701703-8598-470a-be01-afc42f5fe5e4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:28.392607 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d5701703-8598-470a-be01-afc42f5fe5e4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:28.400557 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d5701703-8598-470a-be01-afc42f5fe5e4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1217 microversion: 2.1 time: 0.083375 Aug 30 05:12:28.401114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 31/64] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:28 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:28.424314 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1cdc771e-5f35-4282-a006-cb2f66f6c81c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:28.424924 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1cdc771e-5f35-4282-a006-cb2f66f6c81c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:28.430737 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cdc771e-5f35-4282-a006-cb2f66f6c81c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:28.431249 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cdc771e-5f35-4282-a006-cb2f66f6c81c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:28.431686 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cdc771e-5f35-4282-a006-cb2f66f6c81c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:28.432368 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cdc771e-5f35-4282-a006-cb2f66f6c81c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:28.432822 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cdc771e-5f35-4282-a006-cb2f66f6c81c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:28.433246 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cdc771e-5f35-4282-a006-cb2f66f6c81c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:28.472008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6d5987de-8ca3-4531-9a7b-ef774121f109 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:28.472627 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6d5987de-8ca3-4531-9a7b-ef774121f109 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:28.478617 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d5987de-8ca3-4531-9a7b-ef774121f109 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:28.479132 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d5987de-8ca3-4531-9a7b-ef774121f109 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:28.479566 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d5987de-8ca3-4531-9a7b-ef774121f109 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:28.480253 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d5987de-8ca3-4531-9a7b-ef774121f109 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:28.480704 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d5987de-8ca3-4531-9a7b-ef774121f109 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:28.481129 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d5987de-8ca3-4531-9a7b-ef774121f109 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:28.543928 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6d5987de-8ca3-4531-9a7b-ef774121f109 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:28.551479 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6d5987de-8ca3-4531-9a7b-ef774121f109 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1288 microversion: 2.1 time: 0.083497 Aug 30 05:12:28.552050 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 32/65] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:28 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1288 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:28.560127 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1cdc771e-5f35-4282-a006-cb2f66f6c81c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:28.568269 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1cdc771e-5f35-4282-a006-cb2f66f6c81c tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.147756 Aug 30 05:12:28.568822 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 34/66] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:28 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:29.176313 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-07a26bae-8880-4225-b4b3-161438ce0ef0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:29.177135 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-07a26bae-8880-4225-b4b3-161438ce0ef0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:29.183360 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07a26bae-8880-4225-b4b3-161438ce0ef0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:29.191246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07a26bae-8880-4225-b4b3-161438ce0ef0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:29.191773 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07a26bae-8880-4225-b4b3-161438ce0ef0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:29.193944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07a26bae-8880-4225-b4b3-161438ce0ef0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:29.194438 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07a26bae-8880-4225-b4b3-161438ce0ef0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:29.194889 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-07a26bae-8880-4225-b4b3-161438ce0ef0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:29.355480 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-07a26bae-8880-4225-b4b3-161438ce0ef0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:29.367737 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-07a26bae-8880-4225-b4b3-161438ce0ef0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:29.369518 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-07a26bae-8880-4225-b4b3-161438ce0ef0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:29.371724 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-07a26bae-8880-4225-b4b3-161438ce0ef0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1333 microversion: 2.20 time: 0.199462 Aug 30 05:12:29.372676 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 33/67] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:29 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1333 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:29.422840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aec25983-2c39-4d99-b16c-f6869ad8fa86 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:29.423612 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-aec25983-2c39-4d99-b16c-f6869ad8fa86 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:29.430595 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aec25983-2c39-4d99-b16c-f6869ad8fa86 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:29.431325 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aec25983-2c39-4d99-b16c-f6869ad8fa86 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:29.431958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aec25983-2c39-4d99-b16c-f6869ad8fa86 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:29.432848 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aec25983-2c39-4d99-b16c-f6869ad8fa86 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:29.433638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aec25983-2c39-4d99-b16c-f6869ad8fa86 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:29.435013 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aec25983-2c39-4d99-b16c-f6869ad8fa86 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:29.571058 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fdf5a0b3-fbec-4e0e-8061-29610232bae2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:29.571674 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fdf5a0b3-fbec-4e0e-8061-29610232bae2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:29.583478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdf5a0b3-fbec-4e0e-8061-29610232bae2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:29.583478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdf5a0b3-fbec-4e0e-8061-29610232bae2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:29.583478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdf5a0b3-fbec-4e0e-8061-29610232bae2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:29.583856 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdf5a0b3-fbec-4e0e-8061-29610232bae2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:29.584158 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdf5a0b3-fbec-4e0e-8061-29610232bae2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:29.584576 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fdf5a0b3-fbec-4e0e-8061-29610232bae2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:29.655442 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aec25983-2c39-4d99-b16c-f6869ad8fa86 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:29.666276 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aec25983-2c39-4d99-b16c-f6869ad8fa86 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1273 microversion: 2.1 time: 0.248003 Aug 30 05:12:29.678844 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 35/68] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:29 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1273 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:29.678844 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e9d7ec54-9365-4c8f-8ecc-5cfcaaa3b235 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:29.678844 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e9d7ec54-9365-4c8f-8ecc-5cfcaaa3b235 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:29.679861 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9d7ec54-9365-4c8f-8ecc-5cfcaaa3b235 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:29.680360 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9d7ec54-9365-4c8f-8ecc-5cfcaaa3b235 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:29.680797 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9d7ec54-9365-4c8f-8ecc-5cfcaaa3b235 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:29.682363 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9d7ec54-9365-4c8f-8ecc-5cfcaaa3b235 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:29.682363 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9d7ec54-9365-4c8f-8ecc-5cfcaaa3b235 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:29.682579 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e9d7ec54-9365-4c8f-8ecc-5cfcaaa3b235 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:29.701892 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fdf5a0b3-fbec-4e0e-8061-29610232bae2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:29.713181 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fdf5a0b3-fbec-4e0e-8061-29610232bae2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1288 microversion: 2.1 time: 0.145872 Aug 30 05:12:29.728279 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 34/69] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:29 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1288 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:29.966772 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e9d7ec54-9365-4c8f-8ecc-5cfcaaa3b235 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:29.977212 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e9d7ec54-9365-4c8f-8ecc-5cfcaaa3b235 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.308173 Aug 30 05:12:29.980720 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 36/70] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:29 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:30.255193 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-553212d1-b1b2-4542-854e-3205dfc658d0 req-f820330c-0f38-42d0-9b6f-c18775370246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bae6994-d651-45c7-955b-13df805da49f", "tag": "68faecf3-5b76-4ea3-b631-30ac4f8a4592"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:30.276583 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-553212d1-b1b2-4542-854e-3205dfc658d0 req-f820330c-0f38-42d0-9b6f-c18775370246 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:30.277282 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-553212d1-b1b2-4542-854e-3205dfc658d0 req-f820330c-0f38-42d0-9b6f-c18775370246 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:30.278134 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-553212d1-b1b2-4542-854e-3205dfc658d0 req-f820330c-0f38-42d0-9b6f-c18775370246 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:30.306366 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-553212d1-b1b2-4542-854e-3205dfc658d0 req-f820330c-0f38-42d0-9b6f-c18775370246 service nova] Creating event network-changed:68faecf3-5b76-4ea3-b631-30ac4f8a4592 for instance 2bae6994-d651-45c7-955b-13df805da49f on hv-cinder-85391 Aug 30 05:12:30.307094 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-553212d1-b1b2-4542-854e-3205dfc658d0 req-f820330c-0f38-42d0-9b6f-c18775370246 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120572) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 05:12:30.307567 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-553212d1-b1b2-4542-854e-3205dfc658d0 req-f820330c-0f38-42d0-9b6f-c18775370246 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120572) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 05:12:30.308967 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efe70dc8-e516-4b20-a3ae-e337ae9d52be None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:30.309499 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efe70dc8-e516-4b20-a3ae-e337ae9d52be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:30.310011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efe70dc8-e516-4b20-a3ae-e337ae9d52be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:30.311011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efe70dc8-e516-4b20-a3ae-e337ae9d52be None None] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:30.311524 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efe70dc8-e516-4b20-a3ae-e337ae9d52be None None] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:30.311954 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efe70dc8-e516-4b20-a3ae-e337ae9d52be None None] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:30.328155 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.compute.rpcapi [None req-efe70dc8-e516-4b20-a3ae-e337ae9d52be None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 05:12:30.329203 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-efe70dc8-e516-4b20-a3ae-e337ae9d52be None None] Releasing lock "compute-rpcapi-router" {{(pid=120572) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 05:12:30.342925 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-6de634f1-b024-4a2f-80d5-043aed2a1ee6 req-8a6920eb-13f5-4983-9104-be7e9d1cf6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ec17dd-c9e2-4802-86c7-f985a04be891", "tag": "3231ee58-a276-4f6a-a338-703b3e38ed84"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:30.358529 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6de634f1-b024-4a2f-80d5-043aed2a1ee6 req-8a6920eb-13f5-4983-9104-be7e9d1cf6f1 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:30.359245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6de634f1-b024-4a2f-80d5-043aed2a1ee6 req-8a6920eb-13f5-4983-9104-be7e9d1cf6f1 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:30.359938 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6de634f1-b024-4a2f-80d5-043aed2a1ee6 req-8a6920eb-13f5-4983-9104-be7e9d1cf6f1 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:30.364572 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-efe70dc8-e516-4b20-a3ae-e337ae9d52be None None] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196962 Aug 30 05:12:30.365794 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 35/71] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:12:30.384724 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-6de634f1-b024-4a2f-80d5-043aed2a1ee6 req-8a6920eb-13f5-4983-9104-be7e9d1cf6f1 service nova] Creating event network-changed:3231ee58-a276-4f6a-a338-703b3e38ed84 for instance e0ec17dd-c9e2-4802-86c7-f985a04be891 on hv-cinder-85391 Aug 30 05:12:30.385462 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6de634f1-b024-4a2f-80d5-043aed2a1ee6 req-8a6920eb-13f5-4983-9104-be7e9d1cf6f1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120573) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 05:12:30.385861 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6de634f1-b024-4a2f-80d5-043aed2a1ee6 req-8a6920eb-13f5-4983-9104-be7e9d1cf6f1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120573) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 05:12:30.388538 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3974058-78a9-498e-83b8-d8d2b1e4083d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:30.389036 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3974058-78a9-498e-83b8-d8d2b1e4083d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:30.389476 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3974058-78a9-498e-83b8-d8d2b1e4083d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:30.390336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3974058-78a9-498e-83b8-d8d2b1e4083d None None] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:30.390793 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3974058-78a9-498e-83b8-d8d2b1e4083d None None] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:30.391407 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3974058-78a9-498e-83b8-d8d2b1e4083d None None] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:30.394182 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-21a2ec1f-e852-40db-8b99-00298304af55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:30.398507 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-21a2ec1f-e852-40db-8b99-00298304af55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:30.408551 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21a2ec1f-e852-40db-8b99-00298304af55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:30.409209 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21a2ec1f-e852-40db-8b99-00298304af55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:30.409773 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21a2ec1f-e852-40db-8b99-00298304af55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:30.409972 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.compute.rpcapi [None req-a3974058-78a9-498e-83b8-d8d2b1e4083d None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 05:12:30.410639 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21a2ec1f-e852-40db-8b99-00298304af55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:30.411867 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3974058-78a9-498e-83b8-d8d2b1e4083d None None] Releasing lock "compute-rpcapi-router" {{(pid=120573) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 05:12:30.414450 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21a2ec1f-e852-40db-8b99-00298304af55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:30.414971 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21a2ec1f-e852-40db-8b99-00298304af55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:30.432583 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a3974058-78a9-498e-83b8-d8d2b1e4083d None None] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168376 Aug 30 05:12:30.435555 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 37/72] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:12:30.490197 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-21a2ec1f-e852-40db-8b99-00298304af55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:30.498245 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-21a2ec1f-e852-40db-8b99-00298304af55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:30.499708 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-21a2ec1f-e852-40db-8b99-00298304af55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:30.500814 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-21a2ec1f-e852-40db-8b99-00298304af55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1333 microversion: 2.20 time: 0.111105 Aug 30 05:12:30.501360 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 36/73] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:30 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1333 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:12:30.690119 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-68089a72-bf25-45f3-a055-2abd6fd08125 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:30.690925 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-68089a72-bf25-45f3-a055-2abd6fd08125 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:30.697750 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68089a72-bf25-45f3-a055-2abd6fd08125 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:30.698230 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68089a72-bf25-45f3-a055-2abd6fd08125 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:30.698748 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68089a72-bf25-45f3-a055-2abd6fd08125 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:30.699583 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68089a72-bf25-45f3-a055-2abd6fd08125 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:30.700096 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68089a72-bf25-45f3-a055-2abd6fd08125 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:30.700629 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-68089a72-bf25-45f3-a055-2abd6fd08125 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:30.736602 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fb880f53-a796-49e8-a7e7-6b421f91a5f7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:30.737331 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fb880f53-a796-49e8-a7e7-6b421f91a5f7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:30.744733 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb880f53-a796-49e8-a7e7-6b421f91a5f7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:30.745300 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb880f53-a796-49e8-a7e7-6b421f91a5f7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:30.745832 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb880f53-a796-49e8-a7e7-6b421f91a5f7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:30.746595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb880f53-a796-49e8-a7e7-6b421f91a5f7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:30.747169 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb880f53-a796-49e8-a7e7-6b421f91a5f7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:30.747662 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb880f53-a796-49e8-a7e7-6b421f91a5f7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:30.778511 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-68089a72-bf25-45f3-a055-2abd6fd08125 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:30.788230 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-68089a72-bf25-45f3-a055-2abd6fd08125 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1273 microversion: 2.1 time: 0.102302 Aug 30 05:12:30.789287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 38/74] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:30 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:30.814383 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fb880f53-a796-49e8-a7e7-6b421f91a5f7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:30.822111 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fb880f53-a796-49e8-a7e7-6b421f91a5f7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1288 microversion: 2.1 time: 0.089455 Aug 30 05:12:30.822677 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 37/75] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:30 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:30.997699 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-193cfc2c-9489-4d66-ad4b-5560b10e3b70 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:30.998246 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-193cfc2c-9489-4d66-ad4b-5560b10e3b70 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:31.004092 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-193cfc2c-9489-4d66-ad4b-5560b10e3b70 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:31.004566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-193cfc2c-9489-4d66-ad4b-5560b10e3b70 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:31.004999 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-193cfc2c-9489-4d66-ad4b-5560b10e3b70 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:31.005691 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-193cfc2c-9489-4d66-ad4b-5560b10e3b70 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:31.006151 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-193cfc2c-9489-4d66-ad4b-5560b10e3b70 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:31.006571 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-193cfc2c-9489-4d66-ad4b-5560b10e3b70 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:31.133124 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-193cfc2c-9489-4d66-ad4b-5560b10e3b70 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:31.140582 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-193cfc2c-9489-4d66-ad4b-5560b10e3b70 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.146776 Aug 30 05:12:31.141155 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 39/76] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:30 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:31.523490 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e73c3a73-837c-4f46-84f7-2c2f04068c1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:31.524157 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e73c3a73-837c-4f46-84f7-2c2f04068c1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:31.530129 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e73c3a73-837c-4f46-84f7-2c2f04068c1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:31.530609 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e73c3a73-837c-4f46-84f7-2c2f04068c1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:31.531096 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e73c3a73-837c-4f46-84f7-2c2f04068c1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:31.531781 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e73c3a73-837c-4f46-84f7-2c2f04068c1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:31.532235 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e73c3a73-837c-4f46-84f7-2c2f04068c1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:31.532659 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e73c3a73-837c-4f46-84f7-2c2f04068c1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:31.591522 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e73c3a73-837c-4f46-84f7-2c2f04068c1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:31.599623 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e73c3a73-837c-4f46-84f7-2c2f04068c1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:31.601064 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e73c3a73-837c-4f46-84f7-2c2f04068c1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:31.602159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e73c3a73-837c-4f46-84f7-2c2f04068c1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1333 microversion: 2.20 time: 0.083190 Aug 30 05:12:31.602717 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 38/77] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:31 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1333 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:31.809338 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8b752d1f-d1db-43a9-9396-6d7c1fc50e1c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:31.809944 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8b752d1f-d1db-43a9-9396-6d7c1fc50e1c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:31.816491 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b752d1f-d1db-43a9-9396-6d7c1fc50e1c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:31.816966 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b752d1f-d1db-43a9-9396-6d7c1fc50e1c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:31.817400 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b752d1f-d1db-43a9-9396-6d7c1fc50e1c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:31.818078 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b752d1f-d1db-43a9-9396-6d7c1fc50e1c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:31.818528 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b752d1f-d1db-43a9-9396-6d7c1fc50e1c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:31.818975 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8b752d1f-d1db-43a9-9396-6d7c1fc50e1c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:31.842598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ab8fc412-4f56-41ff-bccf-701d52d3d0e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:31.843243 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ab8fc412-4f56-41ff-bccf-701d52d3d0e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:31.849218 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab8fc412-4f56-41ff-bccf-701d52d3d0e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:31.849691 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab8fc412-4f56-41ff-bccf-701d52d3d0e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:31.850289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab8fc412-4f56-41ff-bccf-701d52d3d0e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:31.851301 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab8fc412-4f56-41ff-bccf-701d52d3d0e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:31.851767 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab8fc412-4f56-41ff-bccf-701d52d3d0e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:31.852184 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab8fc412-4f56-41ff-bccf-701d52d3d0e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:31.881590 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:31.890023 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8b752d1f-d1db-43a9-9396-6d7c1fc50e1c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:31.893469 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:31.898481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8b752d1f-d1db-43a9-9396-6d7c1fc50e1c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1273 microversion: 2.1 time: 0.092914 Aug 30 05:12:31.899145 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 40/78] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:31 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:31.927669 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ab8fc412-4f56-41ff-bccf-701d52d3d0e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:31.935207 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ab8fc412-4f56-41ff-bccf-701d52d3d0e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1288 microversion: 2.1 time: 0.096550 Aug 30 05:12:31.935769 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 39/79] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:31 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1288 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:32.163633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-75b48e6e-6de0-45a4-a5fc-bc8f7bd67227 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:32.164164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-75b48e6e-6de0-45a4-a5fc-bc8f7bd67227 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:32.169901 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75b48e6e-6de0-45a4-a5fc-bc8f7bd67227 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:32.170377 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75b48e6e-6de0-45a4-a5fc-bc8f7bd67227 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:32.170807 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75b48e6e-6de0-45a4-a5fc-bc8f7bd67227 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:32.171507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75b48e6e-6de0-45a4-a5fc-bc8f7bd67227 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:32.171956 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75b48e6e-6de0-45a4-a5fc-bc8f7bd67227 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:32.172374 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75b48e6e-6de0-45a4-a5fc-bc8f7bd67227 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:32.297555 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-75b48e6e-6de0-45a4-a5fc-bc8f7bd67227 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:32.305796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-75b48e6e-6de0-45a4-a5fc-bc8f7bd67227 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.146790 Aug 30 05:12:32.306365 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 41/80] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:32 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:32.630335 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9d4726b4-1790-42bf-a401-2d0ac258dd3c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:32.632489 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9d4726b4-1790-42bf-a401-2d0ac258dd3c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:32.641978 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d4726b4-1790-42bf-a401-2d0ac258dd3c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:32.642808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d4726b4-1790-42bf-a401-2d0ac258dd3c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:32.643413 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d4726b4-1790-42bf-a401-2d0ac258dd3c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:32.645161 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d4726b4-1790-42bf-a401-2d0ac258dd3c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:32.645812 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d4726b4-1790-42bf-a401-2d0ac258dd3c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:32.646291 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d4726b4-1790-42bf-a401-2d0ac258dd3c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:32.768415 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9d4726b4-1790-42bf-a401-2d0ac258dd3c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:32.784356 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9d4726b4-1790-42bf-a401-2d0ac258dd3c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:32.789756 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9d4726b4-1790-42bf-a401-2d0ac258dd3c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:32.792430 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9d4726b4-1790-42bf-a401-2d0ac258dd3c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1341 microversion: 2.20 time: 0.169900 Aug 30 05:12:32.793060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 40/81] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:32 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:12:32.921052 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a3b2aaba-6f7e-49c4-8a6d-acbb927de94b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:32.921777 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a3b2aaba-6f7e-49c4-8a6d-acbb927de94b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:32.932128 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3b2aaba-6f7e-49c4-8a6d-acbb927de94b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:32.937342 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3b2aaba-6f7e-49c4-8a6d-acbb927de94b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:32.937995 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3b2aaba-6f7e-49c4-8a6d-acbb927de94b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:32.938849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3b2aaba-6f7e-49c4-8a6d-acbb927de94b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:32.939398 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3b2aaba-6f7e-49c4-8a6d-acbb927de94b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:32.940034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a3b2aaba-6f7e-49c4-8a6d-acbb927de94b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:32.957591 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-148f45c1-76c1-4afe-94bd-600baaa696fe tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:32.958503 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-148f45c1-76c1-4afe-94bd-600baaa696fe tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:32.966089 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-148f45c1-76c1-4afe-94bd-600baaa696fe tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:32.966980 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-148f45c1-76c1-4afe-94bd-600baaa696fe tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:32.968345 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-148f45c1-76c1-4afe-94bd-600baaa696fe tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:32.971072 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-148f45c1-76c1-4afe-94bd-600baaa696fe tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:32.972722 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-148f45c1-76c1-4afe-94bd-600baaa696fe tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:32.973443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-148f45c1-76c1-4afe-94bd-600baaa696fe tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:33.149361 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a3b2aaba-6f7e-49c4-8a6d-acbb927de94b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:33.158929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a3b2aaba-6f7e-49c4-8a6d-acbb927de94b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1281 microversion: 2.1 time: 0.242480 Aug 30 05:12:33.162855 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 42/82] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:32 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1281 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:33.259939 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-148f45c1-76c1-4afe-94bd-600baaa696fe tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:33.275791 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-148f45c1-76c1-4afe-94bd-600baaa696fe tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1294 microversion: 2.1 time: 0.323052 Aug 30 05:12:33.278766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 41/83] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:32 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1294 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:33.335401 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e71a7d52-dd7c-4fb8-8ef1-ee2a9f348aa6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:33.336782 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e71a7d52-dd7c-4fb8-8ef1-ee2a9f348aa6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:33.345107 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e71a7d52-dd7c-4fb8-8ef1-ee2a9f348aa6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:33.345598 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e71a7d52-dd7c-4fb8-8ef1-ee2a9f348aa6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:33.348623 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e71a7d52-dd7c-4fb8-8ef1-ee2a9f348aa6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:33.351611 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e71a7d52-dd7c-4fb8-8ef1-ee2a9f348aa6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:33.352927 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e71a7d52-dd7c-4fb8-8ef1-ee2a9f348aa6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:33.353761 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e71a7d52-dd7c-4fb8-8ef1-ee2a9f348aa6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:33.817452 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7b9672e1-0509-44a6-8cac-e4ed5a5869fe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:33.818080 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7b9672e1-0509-44a6-8cac-e4ed5a5869fe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:33.826373 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b9672e1-0509-44a6-8cac-e4ed5a5869fe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:33.826937 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b9672e1-0509-44a6-8cac-e4ed5a5869fe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:33.827659 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b9672e1-0509-44a6-8cac-e4ed5a5869fe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:33.828680 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b9672e1-0509-44a6-8cac-e4ed5a5869fe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:33.829673 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b9672e1-0509-44a6-8cac-e4ed5a5869fe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:33.830545 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b9672e1-0509-44a6-8cac-e4ed5a5869fe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:33.966177 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7b9672e1-0509-44a6-8cac-e4ed5a5869fe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:33.979244 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7b9672e1-0509-44a6-8cac-e4ed5a5869fe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:33.984047 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7b9672e1-0509-44a6-8cac-e4ed5a5869fe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:33.988515 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7b9672e1-0509-44a6-8cac-e4ed5a5869fe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1339 microversion: 2.20 time: 0.176679 Aug 30 05:12:33.990982 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 42/84] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:33 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1339 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:12:34.042617 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e71a7d52-dd7c-4fb8-8ef1-ee2a9f348aa6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:34.053189 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e71a7d52-dd7c-4fb8-8ef1-ee2a9f348aa6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.731246 Aug 30 05:12:34.053970 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 43/85] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:33 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:34.182413 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-734827a5-3f62-4312-8b1b-ac55dd82ab2b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:34.183059 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-734827a5-3f62-4312-8b1b-ac55dd82ab2b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:34.189510 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-734827a5-3f62-4312-8b1b-ac55dd82ab2b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:34.190009 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-734827a5-3f62-4312-8b1b-ac55dd82ab2b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:34.190501 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-734827a5-3f62-4312-8b1b-ac55dd82ab2b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:34.191742 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-734827a5-3f62-4312-8b1b-ac55dd82ab2b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:34.192198 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-734827a5-3f62-4312-8b1b-ac55dd82ab2b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:34.192978 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-734827a5-3f62-4312-8b1b-ac55dd82ab2b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:34.304907 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cb09c9fe-36da-4768-833b-562d51bc1d99 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:34.306074 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cb09c9fe-36da-4768-833b-562d51bc1d99 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:34.312830 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb09c9fe-36da-4768-833b-562d51bc1d99 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:34.313541 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb09c9fe-36da-4768-833b-562d51bc1d99 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:34.314452 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb09c9fe-36da-4768-833b-562d51bc1d99 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:34.315414 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb09c9fe-36da-4768-833b-562d51bc1d99 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:34.316449 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb09c9fe-36da-4768-833b-562d51bc1d99 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:34.317090 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cb09c9fe-36da-4768-833b-562d51bc1d99 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:34.445416 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cb09c9fe-36da-4768-833b-562d51bc1d99 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:34.462849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cb09c9fe-36da-4768-833b-562d51bc1d99 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1294 microversion: 2.1 time: 0.163686 Aug 30 05:12:34.466632 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 44/86] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:34 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1294 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:34.498225 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-734827a5-3f62-4312-8b1b-ac55dd82ab2b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:34.514728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-734827a5-3f62-4312-8b1b-ac55dd82ab2b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1321 microversion: 2.1 time: 0.335985 Aug 30 05:12:34.515289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 43/87] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:34 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:35.016511 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dce40882-f795-4f5b-9e83-13be891c6fbc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:35.017159 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dce40882-f795-4f5b-9e83-13be891c6fbc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:35.029898 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dce40882-f795-4f5b-9e83-13be891c6fbc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:35.030506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dce40882-f795-4f5b-9e83-13be891c6fbc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:35.031237 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dce40882-f795-4f5b-9e83-13be891c6fbc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:35.039066 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dce40882-f795-4f5b-9e83-13be891c6fbc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:35.041618 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dce40882-f795-4f5b-9e83-13be891c6fbc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:35.042048 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dce40882-f795-4f5b-9e83-13be891c6fbc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:35.077531 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5370ffe0-8a9e-4146-a38a-ad7d87127810 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:35.078517 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5370ffe0-8a9e-4146-a38a-ad7d87127810 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:35.092145 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5370ffe0-8a9e-4146-a38a-ad7d87127810 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:35.109114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5370ffe0-8a9e-4146-a38a-ad7d87127810 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:35.112433 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5370ffe0-8a9e-4146-a38a-ad7d87127810 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:35.118028 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5370ffe0-8a9e-4146-a38a-ad7d87127810 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:35.125202 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5370ffe0-8a9e-4146-a38a-ad7d87127810 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:35.127761 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5370ffe0-8a9e-4146-a38a-ad7d87127810 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:35.575410 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dce40882-f795-4f5b-9e83-13be891c6fbc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:35.626193 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dce40882-f795-4f5b-9e83-13be891c6fbc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:35.655339 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dce40882-f795-4f5b-9e83-13be891c6fbc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:35.665616 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5370ffe0-8a9e-4146-a38a-ad7d87127810 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:35.665914 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dce40882-f795-4f5b-9e83-13be891c6fbc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1407 microversion: 2.20 time: 0.651442 Aug 30 05:12:35.666139 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 45/88] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:35 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1407 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:35.683564 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aae1d3ba-c456-4e2b-97d5-72d8693e4e2a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:35.685837 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-aae1d3ba-c456-4e2b-97d5-72d8693e4e2a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:35.692484 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5370ffe0-8a9e-4146-a38a-ad7d87127810 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.614449 Aug 30 05:12:35.692484 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 44/89] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:35 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:35.696767 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0087cc7c-da41-4091-a35c-970d54a74420 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:35.697559 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0087cc7c-da41-4091-a35c-970d54a74420 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:35.711173 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0087cc7c-da41-4091-a35c-970d54a74420 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:35.713689 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0087cc7c-da41-4091-a35c-970d54a74420 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:35.713969 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0087cc7c-da41-4091-a35c-970d54a74420 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:35.714865 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0087cc7c-da41-4091-a35c-970d54a74420 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:35.721274 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0087cc7c-da41-4091-a35c-970d54a74420 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:35.721274 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0087cc7c-da41-4091-a35c-970d54a74420 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:35.723151 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aae1d3ba-c456-4e2b-97d5-72d8693e4e2a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:35.728435 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aae1d3ba-c456-4e2b-97d5-72d8693e4e2a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:35.729237 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aae1d3ba-c456-4e2b-97d5-72d8693e4e2a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:35.739364 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aae1d3ba-c456-4e2b-97d5-72d8693e4e2a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:35.740016 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aae1d3ba-c456-4e2b-97d5-72d8693e4e2a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:35.740662 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aae1d3ba-c456-4e2b-97d5-72d8693e4e2a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:36.023317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0087cc7c-da41-4091-a35c-970d54a74420 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:36.033518 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0087cc7c-da41-4091-a35c-970d54a74420 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1321 microversion: 2.1 time: 0.344113 Aug 30 05:12:36.034994 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 45/90] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:35 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:36.179555 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aae1d3ba-c456-4e2b-97d5-72d8693e4e2a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:36.191657 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aae1d3ba-c456-4e2b-97d5-72d8693e4e2a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1361 microversion: 2.1 time: 0.524164 Aug 30 05:12:36.192363 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 46/91] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:35 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1361 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:36.657999 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-bbbfb838-e896-4661-9ae7-57fab3802be6 req-de869e6c-8b20-48d6-9ddc-487bb1eb1faf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43143409-91ae-49e1-a4d3-688ea54d1d0b", "tag": "04285150-7904-4555-9230-fcb76ec2800d"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:36.669129 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bbbfb838-e896-4661-9ae7-57fab3802be6 req-de869e6c-8b20-48d6-9ddc-487bb1eb1faf service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:36.669853 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bbbfb838-e896-4661-9ae7-57fab3802be6 req-de869e6c-8b20-48d6-9ddc-487bb1eb1faf service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:36.670280 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bbbfb838-e896-4661-9ae7-57fab3802be6 req-de869e6c-8b20-48d6-9ddc-487bb1eb1faf service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:36.684165 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-bbbfb838-e896-4661-9ae7-57fab3802be6 req-de869e6c-8b20-48d6-9ddc-487bb1eb1faf service nova] Creating event network-changed:04285150-7904-4555-9230-fcb76ec2800d for instance 43143409-91ae-49e1-a4d3-688ea54d1d0b on hv-cinder-85391 Aug 30 05:12:36.690373 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-bbbfb838-e896-4661-9ae7-57fab3802be6 req-de869e6c-8b20-48d6-9ddc-487bb1eb1faf service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036888 Aug 30 05:12:36.691501 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 46/92] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:12:36.700022 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-985ed047-93a4-49c9-b5a4-3094c8a75aa9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:36.701936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-985ed047-93a4-49c9-b5a4-3094c8a75aa9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:36.723318 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-985ed047-93a4-49c9-b5a4-3094c8a75aa9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:36.723865 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b122d04c-8396-41e5-ac1c-7c3b69aee7f4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:36.724640 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-985ed047-93a4-49c9-b5a4-3094c8a75aa9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:36.725155 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-985ed047-93a4-49c9-b5a4-3094c8a75aa9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:36.725274 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b122d04c-8396-41e5-ac1c-7c3b69aee7f4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:36.725913 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-985ed047-93a4-49c9-b5a4-3094c8a75aa9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:36.726543 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-985ed047-93a4-49c9-b5a4-3094c8a75aa9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:36.727090 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-985ed047-93a4-49c9-b5a4-3094c8a75aa9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:36.735358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b122d04c-8396-41e5-ac1c-7c3b69aee7f4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:36.736323 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b122d04c-8396-41e5-ac1c-7c3b69aee7f4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:36.737217 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b122d04c-8396-41e5-ac1c-7c3b69aee7f4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:36.740249 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b122d04c-8396-41e5-ac1c-7c3b69aee7f4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:36.741003 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b122d04c-8396-41e5-ac1c-7c3b69aee7f4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:36.741737 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b122d04c-8396-41e5-ac1c-7c3b69aee7f4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:36.904461 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b122d04c-8396-41e5-ac1c-7c3b69aee7f4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:36.915077 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b122d04c-8396-41e5-ac1c-7c3b69aee7f4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.198939 Aug 30 05:12:36.929433 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 47/93] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:36 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:36.935020 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-c1b3efe4-4c68-4d11-8a5e-d42f066a2662 req-c92c0e69-cad7-4aa6-988e-a2a65e1d4190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a54dc6f-8cee-4b66-9486-491841d01c27", "tag": "a8fa1465-9fa9-4b85-9370-89b6902a982d"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:36.946604 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-c1b3efe4-4c68-4d11-8a5e-d42f066a2662 req-c92c0e69-cad7-4aa6-988e-a2a65e1d4190 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:36.947322 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-c1b3efe4-4c68-4d11-8a5e-d42f066a2662 req-c92c0e69-cad7-4aa6-988e-a2a65e1d4190 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:36.947908 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-c1b3efe4-4c68-4d11-8a5e-d42f066a2662 req-c92c0e69-cad7-4aa6-988e-a2a65e1d4190 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:36.960484 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-c1b3efe4-4c68-4d11-8a5e-d42f066a2662 req-c92c0e69-cad7-4aa6-988e-a2a65e1d4190 service nova] Creating event network-changed:a8fa1465-9fa9-4b85-9370-89b6902a982d for instance 2a54dc6f-8cee-4b66-9486-491841d01c27 on hv-cinder-85391 Aug 30 05:12:36.966087 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-c1b3efe4-4c68-4d11-8a5e-d42f066a2662 req-c92c0e69-cad7-4aa6-988e-a2a65e1d4190 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035218 Aug 30 05:12:36.966753 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 48/94] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:12:37.052329 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-985ed047-93a4-49c9-b5a4-3094c8a75aa9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:37.055666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-05e6d793-ddb6-4908-a9cf-3064eec7ce3d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:37.057218 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-05e6d793-ddb6-4908-a9cf-3064eec7ce3d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:37.063828 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05e6d793-ddb6-4908-a9cf-3064eec7ce3d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:37.064528 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05e6d793-ddb6-4908-a9cf-3064eec7ce3d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:37.065133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05e6d793-ddb6-4908-a9cf-3064eec7ce3d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:37.065865 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05e6d793-ddb6-4908-a9cf-3064eec7ce3d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:37.066493 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05e6d793-ddb6-4908-a9cf-3064eec7ce3d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:37.067140 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-05e6d793-ddb6-4908-a9cf-3064eec7ce3d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:37.067662 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-985ed047-93a4-49c9-b5a4-3094c8a75aa9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:37.074277 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-985ed047-93a4-49c9-b5a4-3094c8a75aa9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:37.075485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-985ed047-93a4-49c9-b5a4-3094c8a75aa9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1407 microversion: 2.20 time: 0.385149 Aug 30 05:12:37.076055 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 47/95] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:36 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1407 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:37.215533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b086d888-7372-4425-9129-5ed0ea5a7580 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:37.216327 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b086d888-7372-4425-9129-5ed0ea5a7580 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:37.224798 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b086d888-7372-4425-9129-5ed0ea5a7580 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:37.225475 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b086d888-7372-4425-9129-5ed0ea5a7580 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:37.225897 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b086d888-7372-4425-9129-5ed0ea5a7580 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:37.227066 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b086d888-7372-4425-9129-5ed0ea5a7580 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:37.227779 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b086d888-7372-4425-9129-5ed0ea5a7580 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:37.228354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b086d888-7372-4425-9129-5ed0ea5a7580 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:37.307273 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-05e6d793-ddb6-4908-a9cf-3064eec7ce3d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:37.318649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-05e6d793-ddb6-4908-a9cf-3064eec7ce3d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1321 microversion: 2.1 time: 0.267182 Aug 30 05:12:37.319766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 49/96] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:37 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:37.498497 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b086d888-7372-4425-9129-5ed0ea5a7580 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:37.507865 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b086d888-7372-4425-9129-5ed0ea5a7580 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1361 microversion: 2.1 time: 0.298131 Aug 30 05:12:37.508257 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 48/97] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:37 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1361 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:37.935967 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7382c7c6-48fb-4eda-9500-48ab0be45ab6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:37.936747 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7382c7c6-48fb-4eda-9500-48ab0be45ab6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:37.944264 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7382c7c6-48fb-4eda-9500-48ab0be45ab6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:37.944779 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7382c7c6-48fb-4eda-9500-48ab0be45ab6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:37.945546 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7382c7c6-48fb-4eda-9500-48ab0be45ab6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:37.946241 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7382c7c6-48fb-4eda-9500-48ab0be45ab6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:37.946684 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7382c7c6-48fb-4eda-9500-48ab0be45ab6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:37.947236 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7382c7c6-48fb-4eda-9500-48ab0be45ab6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:38.098085 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2729fb73-7dbd-4bea-abeb-2b1f7c82d1f9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:38.098801 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2729fb73-7dbd-4bea-abeb-2b1f7c82d1f9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:38.105020 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2729fb73-7dbd-4bea-abeb-2b1f7c82d1f9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:38.105579 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2729fb73-7dbd-4bea-abeb-2b1f7c82d1f9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:38.106239 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2729fb73-7dbd-4bea-abeb-2b1f7c82d1f9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:38.107177 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2729fb73-7dbd-4bea-abeb-2b1f7c82d1f9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:38.107865 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2729fb73-7dbd-4bea-abeb-2b1f7c82d1f9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:38.108349 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2729fb73-7dbd-4bea-abeb-2b1f7c82d1f9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:38.158272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7382c7c6-48fb-4eda-9500-48ab0be45ab6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:38.169331 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7382c7c6-48fb-4eda-9500-48ab0be45ab6 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.237292 Aug 30 05:12:38.180149 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 50/98] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:37 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:38.280166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2729fb73-7dbd-4bea-abeb-2b1f7c82d1f9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:38.289218 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2729fb73-7dbd-4bea-abeb-2b1f7c82d1f9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:38.291090 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2729fb73-7dbd-4bea-abeb-2b1f7c82d1f9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:38.292470 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2729fb73-7dbd-4bea-abeb-2b1f7c82d1f9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1407 microversion: 2.20 time: 0.198897 Aug 30 05:12:38.307367 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 49/99] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:38 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:12:38.345994 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fa40e65b-4c8a-4968-a64d-fac3d3415f93 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:38.347135 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fa40e65b-4c8a-4968-a64d-fac3d3415f93 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:38.355159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa40e65b-4c8a-4968-a64d-fac3d3415f93 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:38.355651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa40e65b-4c8a-4968-a64d-fac3d3415f93 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:38.356239 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa40e65b-4c8a-4968-a64d-fac3d3415f93 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:38.356870 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa40e65b-4c8a-4968-a64d-fac3d3415f93 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:38.357523 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa40e65b-4c8a-4968-a64d-fac3d3415f93 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:38.357952 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa40e65b-4c8a-4968-a64d-fac3d3415f93 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:38.527838 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2a56fc0f-5d27-497f-bee7-0bdc9f8dfa15 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:38.528460 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2a56fc0f-5d27-497f-bee7-0bdc9f8dfa15 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:38.534720 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a56fc0f-5d27-497f-bee7-0bdc9f8dfa15 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:38.535487 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a56fc0f-5d27-497f-bee7-0bdc9f8dfa15 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:38.536071 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a56fc0f-5d27-497f-bee7-0bdc9f8dfa15 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:38.536922 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a56fc0f-5d27-497f-bee7-0bdc9f8dfa15 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:38.537963 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a56fc0f-5d27-497f-bee7-0bdc9f8dfa15 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:38.538546 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a56fc0f-5d27-497f-bee7-0bdc9f8dfa15 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:38.562159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fa40e65b-4c8a-4968-a64d-fac3d3415f93 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:38.571864 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fa40e65b-4c8a-4968-a64d-fac3d3415f93 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1321 microversion: 2.1 time: 0.229977 Aug 30 05:12:38.573206 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 51/100] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:38 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:39.004543 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-ac767953-c0e3-4cc9-b745-22778ae38eaa req-69bd191c-c61f-48f9-8259-f0ae0347d7be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f83c589-3a23-45aa-96c5-3cf9006b3830", "tag": "c5da19b6-98a0-4af9-b8f5-52291d4a9be0"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:39.029195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ac767953-c0e3-4cc9-b745-22778ae38eaa req-69bd191c-c61f-48f9-8259-f0ae0347d7be service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:39.031717 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ac767953-c0e3-4cc9-b745-22778ae38eaa req-69bd191c-c61f-48f9-8259-f0ae0347d7be service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:39.032247 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-ac767953-c0e3-4cc9-b745-22778ae38eaa req-69bd191c-c61f-48f9-8259-f0ae0347d7be service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:39.049606 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-ac767953-c0e3-4cc9-b745-22778ae38eaa req-69bd191c-c61f-48f9-8259-f0ae0347d7be service nova] Creating event network-changed:c5da19b6-98a0-4af9-b8f5-52291d4a9be0 for instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 on hv-cinder-85391 Aug 30 05:12:39.070582 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-ac767953-c0e3-4cc9-b745-22778ae38eaa req-69bd191c-c61f-48f9-8259-f0ae0347d7be service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071186 Aug 30 05:12:39.071921 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 52/101] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:12:39.194003 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d87884c5-17f2-4f4d-b9f3-68332983a7a5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:39.194906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d87884c5-17f2-4f4d-b9f3-68332983a7a5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:39.202572 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d87884c5-17f2-4f4d-b9f3-68332983a7a5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:39.203363 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d87884c5-17f2-4f4d-b9f3-68332983a7a5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:39.204717 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d87884c5-17f2-4f4d-b9f3-68332983a7a5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:39.205625 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d87884c5-17f2-4f4d-b9f3-68332983a7a5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:39.207120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d87884c5-17f2-4f4d-b9f3-68332983a7a5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:39.209301 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d87884c5-17f2-4f4d-b9f3-68332983a7a5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:39.391576 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d87884c5-17f2-4f4d-b9f3-68332983a7a5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:39.402118 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d87884c5-17f2-4f4d-b9f3-68332983a7a5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.212867 Aug 30 05:12:39.402684 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 53/102] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:39 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:39.408527 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7f6f51cc-099d-4f93-8add-8d013e5871a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:39.410072 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7f6f51cc-099d-4f93-8add-8d013e5871a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:39.417362 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f6f51cc-099d-4f93-8add-8d013e5871a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:39.418399 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f6f51cc-099d-4f93-8add-8d013e5871a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:39.419292 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f6f51cc-099d-4f93-8add-8d013e5871a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:39.420247 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f6f51cc-099d-4f93-8add-8d013e5871a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:39.421029 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f6f51cc-099d-4f93-8add-8d013e5871a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:39.421573 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7f6f51cc-099d-4f93-8add-8d013e5871a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:39.427328 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2a56fc0f-5d27-497f-bee7-0bdc9f8dfa15 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:39.440587 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2a56fc0f-5d27-497f-bee7-0bdc9f8dfa15 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1361 microversion: 2.1 time: 0.916360 Aug 30 05:12:39.441399 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 50/103] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:38 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1361 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:39.596249 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3bb41656-beb2-42dc-8bb4-5ba2a71b2393 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:39.597331 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3bb41656-beb2-42dc-8bb4-5ba2a71b2393 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:39.603443 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3bb41656-beb2-42dc-8bb4-5ba2a71b2393 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:39.604117 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3bb41656-beb2-42dc-8bb4-5ba2a71b2393 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:39.604736 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3bb41656-beb2-42dc-8bb4-5ba2a71b2393 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:39.605699 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3bb41656-beb2-42dc-8bb4-5ba2a71b2393 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:39.606410 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3bb41656-beb2-42dc-8bb4-5ba2a71b2393 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:39.607193 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3bb41656-beb2-42dc-8bb4-5ba2a71b2393 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:39.620899 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7f6f51cc-099d-4f93-8add-8d013e5871a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:39.633199 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7f6f51cc-099d-4f93-8add-8d013e5871a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:39.635382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7f6f51cc-099d-4f93-8add-8d013e5871a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:39.636828 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7f6f51cc-099d-4f93-8add-8d013e5871a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1407 microversion: 2.20 time: 0.232514 Aug 30 05:12:39.650842 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 54/104] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:39 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:39.782270 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3bb41656-beb2-42dc-8bb4-5ba2a71b2393 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:39.790750 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3bb41656-beb2-42dc-8bb4-5ba2a71b2393 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1321 microversion: 2.1 time: 0.198342 Aug 30 05:12:39.791353 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 51/105] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:39 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:40.426320 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-88aa004a-479b-4d68-8f37-9ee9140792be tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:40.427075 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-88aa004a-479b-4d68-8f37-9ee9140792be tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:40.429184 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:40.434734 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88aa004a-479b-4d68-8f37-9ee9140792be tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:40.435252 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88aa004a-479b-4d68-8f37-9ee9140792be tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:40.435659 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88aa004a-479b-4d68-8f37-9ee9140792be tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:40.436334 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88aa004a-479b-4d68-8f37-9ee9140792be tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:40.436787 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88aa004a-479b-4d68-8f37-9ee9140792be tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:40.437359 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88aa004a-479b-4d68-8f37-9ee9140792be tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:40.459654 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:40.470178 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6687a121-4295-407a-97fb-8eb08239c666 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:40.470795 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6687a121-4295-407a-97fb-8eb08239c666 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:40.492698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6687a121-4295-407a-97fb-8eb08239c666 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:40.494458 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6687a121-4295-407a-97fb-8eb08239c666 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:40.494941 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6687a121-4295-407a-97fb-8eb08239c666 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:40.495645 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6687a121-4295-407a-97fb-8eb08239c666 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:40.496091 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6687a121-4295-407a-97fb-8eb08239c666 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:40.496690 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6687a121-4295-407a-97fb-8eb08239c666 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:40.619177 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-88aa004a-479b-4d68-8f37-9ee9140792be tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:40.630971 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-88aa004a-479b-4d68-8f37-9ee9140792be tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.209245 Aug 30 05:12:40.632386 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 55/106] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:40 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:40.664661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9824da37-d2b1-4530-b393-2c8b93ab19d2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:40.665774 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9824da37-d2b1-4530-b393-2c8b93ab19d2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:40.671819 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9824da37-d2b1-4530-b393-2c8b93ab19d2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:40.672612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9824da37-d2b1-4530-b393-2c8b93ab19d2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:40.673137 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9824da37-d2b1-4530-b393-2c8b93ab19d2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:40.673918 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9824da37-d2b1-4530-b393-2c8b93ab19d2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:40.674548 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9824da37-d2b1-4530-b393-2c8b93ab19d2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:40.675230 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9824da37-d2b1-4530-b393-2c8b93ab19d2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:40.680193 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6687a121-4295-407a-97fb-8eb08239c666 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:40.688049 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6687a121-4295-407a-97fb-8eb08239c666 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1361 microversion: 2.1 time: 0.230672 Aug 30 05:12:40.688929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 52/107] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:40 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:40.811175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d89a7474-ceb7-43a9-935f-bd5a431ec406 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:40.811818 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d89a7474-ceb7-43a9-935f-bd5a431ec406 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:40.813071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9824da37-d2b1-4530-b393-2c8b93ab19d2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:40.818021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d89a7474-ceb7-43a9-935f-bd5a431ec406 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:40.818504 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d89a7474-ceb7-43a9-935f-bd5a431ec406 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:40.818983 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d89a7474-ceb7-43a9-935f-bd5a431ec406 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:40.819673 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d89a7474-ceb7-43a9-935f-bd5a431ec406 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:40.820150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d89a7474-ceb7-43a9-935f-bd5a431ec406 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:40.820692 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d89a7474-ceb7-43a9-935f-bd5a431ec406 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:40.822086 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9824da37-d2b1-4530-b393-2c8b93ab19d2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:40.823604 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9824da37-d2b1-4530-b393-2c8b93ab19d2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:40.824782 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9824da37-d2b1-4530-b393-2c8b93ab19d2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1407 microversion: 2.20 time: 0.164263 Aug 30 05:12:40.829909 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 56/108] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:40 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:12:40.951078 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d89a7474-ceb7-43a9-935f-bd5a431ec406 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:40.966953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d89a7474-ceb7-43a9-935f-bd5a431ec406 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1321 microversion: 2.1 time: 0.160353 Aug 30 05:12:40.967533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 53/109] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:40 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:41.656290 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d116ad57-3e0d-4675-9f13-a2da552657b1 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:41.656905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d116ad57-3e0d-4675-9f13-a2da552657b1 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:41.663512 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d116ad57-3e0d-4675-9f13-a2da552657b1 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:41.663986 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d116ad57-3e0d-4675-9f13-a2da552657b1 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:41.664447 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d116ad57-3e0d-4675-9f13-a2da552657b1 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:41.665126 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d116ad57-3e0d-4675-9f13-a2da552657b1 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:41.665572 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d116ad57-3e0d-4675-9f13-a2da552657b1 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:41.665990 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d116ad57-3e0d-4675-9f13-a2da552657b1 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:41.708685 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-197338c7-5eb8-49f4-82a7-5ebecba8c82b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:41.709294 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-197338c7-5eb8-49f4-82a7-5ebecba8c82b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:41.715181 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-197338c7-5eb8-49f4-82a7-5ebecba8c82b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:41.715666 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-197338c7-5eb8-49f4-82a7-5ebecba8c82b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:41.716092 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-197338c7-5eb8-49f4-82a7-5ebecba8c82b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:41.716780 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-197338c7-5eb8-49f4-82a7-5ebecba8c82b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:41.717230 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-197338c7-5eb8-49f4-82a7-5ebecba8c82b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:41.717652 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-197338c7-5eb8-49f4-82a7-5ebecba8c82b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:41.794969 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d116ad57-3e0d-4675-9f13-a2da552657b1 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:41.802646 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d116ad57-3e0d-4675-9f13-a2da552657b1 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.153650 Aug 30 05:12:41.803251 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 57/110] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:41 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:41.850894 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ef024fc6-37a8-45c1-85bb-e3f36aa28e58 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:41.851869 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ef024fc6-37a8-45c1-85bb-e3f36aa28e58 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:41.861247 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef024fc6-37a8-45c1-85bb-e3f36aa28e58 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:41.862237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef024fc6-37a8-45c1-85bb-e3f36aa28e58 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:41.863601 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef024fc6-37a8-45c1-85bb-e3f36aa28e58 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:41.864791 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef024fc6-37a8-45c1-85bb-e3f36aa28e58 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:41.865804 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef024fc6-37a8-45c1-85bb-e3f36aa28e58 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:41.866783 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef024fc6-37a8-45c1-85bb-e3f36aa28e58 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:41.873235 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:41.979996 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-197338c7-5eb8-49f4-82a7-5ebecba8c82b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:42.002468 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-197338c7-5eb8-49f4-82a7-5ebecba8c82b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1361 microversion: 2.1 time: 0.297919 Aug 30 05:12:42.020968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 54/111] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:41 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1361 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:42.053680 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-91963806-8073-4c31-aeea-67259a5ff1d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:42.055073 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-91963806-8073-4c31-aeea-67259a5ff1d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:42.069719 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91963806-8073-4c31-aeea-67259a5ff1d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:42.076804 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91963806-8073-4c31-aeea-67259a5ff1d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:42.080699 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91963806-8073-4c31-aeea-67259a5ff1d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:42.083363 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91963806-8073-4c31-aeea-67259a5ff1d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:42.084023 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91963806-8073-4c31-aeea-67259a5ff1d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:42.084606 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-91963806-8073-4c31-aeea-67259a5ff1d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:42.300419 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ef024fc6-37a8-45c1-85bb-e3f36aa28e58 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:42.309580 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ef024fc6-37a8-45c1-85bb-e3f36aa28e58 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:42.311302 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ef024fc6-37a8-45c1-85bb-e3f36aa28e58 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:42.312648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ef024fc6-37a8-45c1-85bb-e3f36aa28e58 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1407 microversion: 2.20 time: 0.469634 Aug 30 05:12:42.327565 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 58/112] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:41 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1407 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:42.470141 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-91963806-8073-4c31-aeea-67259a5ff1d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:42.480274 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-91963806-8073-4c31-aeea-67259a5ff1d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1321 microversion: 2.1 time: 0.456114 Aug 30 05:12:42.481242 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 55/113] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:42 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1321 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:42.823348 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-50caf521-8675-4e3d-a62a-86852a8792c4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:42.823986 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-50caf521-8675-4e3d-a62a-86852a8792c4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:42.830035 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50caf521-8675-4e3d-a62a-86852a8792c4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:42.830518 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50caf521-8675-4e3d-a62a-86852a8792c4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:42.830997 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50caf521-8675-4e3d-a62a-86852a8792c4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:42.831691 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50caf521-8675-4e3d-a62a-86852a8792c4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:42.832136 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50caf521-8675-4e3d-a62a-86852a8792c4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:42.832557 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-50caf521-8675-4e3d-a62a-86852a8792c4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:43.015029 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-50caf521-8675-4e3d-a62a-86852a8792c4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:43.028105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-50caf521-8675-4e3d-a62a-86852a8792c4 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.208612 Aug 30 05:12:43.030884 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 59/114] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:42 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:43.032239 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-53a6740e-78cc-4ce1-ada1-c1eda674b8ac tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:43.032847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-53a6740e-78cc-4ce1-ada1-c1eda674b8ac tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:43.040447 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53a6740e-78cc-4ce1-ada1-c1eda674b8ac tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:43.040944 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53a6740e-78cc-4ce1-ada1-c1eda674b8ac tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:43.041375 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53a6740e-78cc-4ce1-ada1-c1eda674b8ac tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:43.042238 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53a6740e-78cc-4ce1-ada1-c1eda674b8ac tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:43.042698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53a6740e-78cc-4ce1-ada1-c1eda674b8ac tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:43.043153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53a6740e-78cc-4ce1-ada1-c1eda674b8ac tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:43.260963 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-53a6740e-78cc-4ce1-ada1-c1eda674b8ac tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:43.270001 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-53a6740e-78cc-4ce1-ada1-c1eda674b8ac tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1361 microversion: 2.1 time: 0.241573 Aug 30 05:12:43.271321 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 56/115] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:43 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1361 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:43.338808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a93a271a-6657-4664-a355-0faf3bdeffb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:43.339493 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a93a271a-6657-4664-a355-0faf3bdeffb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:43.346162 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a93a271a-6657-4664-a355-0faf3bdeffb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:43.346689 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a93a271a-6657-4664-a355-0faf3bdeffb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:43.347154 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a93a271a-6657-4664-a355-0faf3bdeffb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:43.347847 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a93a271a-6657-4664-a355-0faf3bdeffb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:43.348290 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a93a271a-6657-4664-a355-0faf3bdeffb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:43.348910 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a93a271a-6657-4664-a355-0faf3bdeffb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:43.509586 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fec4fd22-b7de-4676-8f47-a703d25a2423 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:43.510646 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fec4fd22-b7de-4676-8f47-a703d25a2423 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:43.520303 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fec4fd22-b7de-4676-8f47-a703d25a2423 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:43.522130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fec4fd22-b7de-4676-8f47-a703d25a2423 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:43.523040 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fec4fd22-b7de-4676-8f47-a703d25a2423 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:43.524894 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fec4fd22-b7de-4676-8f47-a703d25a2423 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:43.525741 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fec4fd22-b7de-4676-8f47-a703d25a2423 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:43.526514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fec4fd22-b7de-4676-8f47-a703d25a2423 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:43.536855 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a93a271a-6657-4664-a355-0faf3bdeffb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:43.547837 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a93a271a-6657-4664-a355-0faf3bdeffb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:43.550247 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a93a271a-6657-4664-a355-0faf3bdeffb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:43.564093 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a93a271a-6657-4664-a355-0faf3bdeffb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1407 microversion: 2.20 time: 0.217034 Aug 30 05:12:43.564093 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 60/116] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:43 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:43.579320 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:43.843051 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fec4fd22-b7de-4676-8f47-a703d25a2423 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:43.851299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fec4fd22-b7de-4676-8f47-a703d25a2423 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1321 microversion: 2.1 time: 0.353540 Aug 30 05:12:43.851869 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 57/117] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:43 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:44.048930 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-97733f01-bcb6-46ae-a339-231ecbafcc24 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:44.050171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-97733f01-bcb6-46ae-a339-231ecbafcc24 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:44.056029 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97733f01-bcb6-46ae-a339-231ecbafcc24 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:44.056516 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97733f01-bcb6-46ae-a339-231ecbafcc24 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:44.056954 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97733f01-bcb6-46ae-a339-231ecbafcc24 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:44.057640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97733f01-bcb6-46ae-a339-231ecbafcc24 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:44.058095 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97733f01-bcb6-46ae-a339-231ecbafcc24 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:44.058520 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97733f01-bcb6-46ae-a339-231ecbafcc24 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:44.191965 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-97733f01-bcb6-46ae-a339-231ecbafcc24 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:44.199949 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-97733f01-bcb6-46ae-a339-231ecbafcc24 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.154932 Aug 30 05:12:44.200520 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 61/118] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:44 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:44.291178 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-de7043fe-2aed-4fae-9ef8-aadf80de8960 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:44.291790 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-de7043fe-2aed-4fae-9ef8-aadf80de8960 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:44.297874 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de7043fe-2aed-4fae-9ef8-aadf80de8960 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:44.298471 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de7043fe-2aed-4fae-9ef8-aadf80de8960 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:44.298929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de7043fe-2aed-4fae-9ef8-aadf80de8960 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:44.300222 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de7043fe-2aed-4fae-9ef8-aadf80de8960 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:44.300680 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de7043fe-2aed-4fae-9ef8-aadf80de8960 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:44.301103 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de7043fe-2aed-4fae-9ef8-aadf80de8960 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:44.590107 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-21daa38f-8adf-44ef-b026-c007de25ed7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:44.591115 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-21daa38f-8adf-44ef-b026-c007de25ed7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:44.598945 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21daa38f-8adf-44ef-b026-c007de25ed7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:44.599919 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21daa38f-8adf-44ef-b026-c007de25ed7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:44.600580 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21daa38f-8adf-44ef-b026-c007de25ed7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:44.601487 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21daa38f-8adf-44ef-b026-c007de25ed7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:44.602225 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21daa38f-8adf-44ef-b026-c007de25ed7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:44.602891 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-21daa38f-8adf-44ef-b026-c007de25ed7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:44.689799 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-de7043fe-2aed-4fae-9ef8-aadf80de8960 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:44.702608 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-de7043fe-2aed-4fae-9ef8-aadf80de8960 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1361 microversion: 2.1 time: 0.415353 Aug 30 05:12:44.708841 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 58/119] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:44 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1361 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:44.760482 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-21daa38f-8adf-44ef-b026-c007de25ed7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:44.771904 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-21daa38f-8adf-44ef-b026-c007de25ed7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:44.774176 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-21daa38f-8adf-44ef-b026-c007de25ed7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:44.775601 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-21daa38f-8adf-44ef-b026-c007de25ed7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1407 microversion: 2.20 time: 0.189572 Aug 30 05:12:44.776879 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 62/120] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:44 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:12:44.872903 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-db567d25-0bb6-4743-8c2f-cfd47e827cfe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:44.873531 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-db567d25-0bb6-4743-8c2f-cfd47e827cfe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:44.881307 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db567d25-0bb6-4743-8c2f-cfd47e827cfe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:44.882169 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db567d25-0bb6-4743-8c2f-cfd47e827cfe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:44.882810 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db567d25-0bb6-4743-8c2f-cfd47e827cfe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:44.883847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db567d25-0bb6-4743-8c2f-cfd47e827cfe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:44.884488 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db567d25-0bb6-4743-8c2f-cfd47e827cfe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:44.885102 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-db567d25-0bb6-4743-8c2f-cfd47e827cfe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:45.099976 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-db567d25-0bb6-4743-8c2f-cfd47e827cfe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:45.115423 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-db567d25-0bb6-4743-8c2f-cfd47e827cfe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1321 microversion: 2.1 time: 0.245513 Aug 30 05:12:45.116797 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 59/121] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:44 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:45.222319 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-113aa9fa-f798-47c8-b600-4fca5b29e2bc tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:45.233328 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-113aa9fa-f798-47c8-b600-4fca5b29e2bc tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:45.241098 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-113aa9fa-f798-47c8-b600-4fca5b29e2bc tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:45.241875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-113aa9fa-f798-47c8-b600-4fca5b29e2bc tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:45.242637 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-113aa9fa-f798-47c8-b600-4fca5b29e2bc tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:45.243519 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-113aa9fa-f798-47c8-b600-4fca5b29e2bc tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:45.244124 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-113aa9fa-f798-47c8-b600-4fca5b29e2bc tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:45.244698 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-113aa9fa-f798-47c8-b600-4fca5b29e2bc tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:45.346493 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-d9aa7d44-e1b8-4a08-a66c-e37120334a30 req-5098bb9e-3063-4422-aa66-7a744043d04d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bae6994-d651-45c7-955b-13df805da49f", "name": "network-vif-plugged", "status": "completed", "tag": "68faecf3-5b76-4ea3-b631-30ac4f8a4592"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:45.358004 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d9aa7d44-e1b8-4a08-a66c-e37120334a30 req-5098bb9e-3063-4422-aa66-7a744043d04d service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:45.358483 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d9aa7d44-e1b8-4a08-a66c-e37120334a30 req-5098bb9e-3063-4422-aa66-7a744043d04d service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:45.359177 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d9aa7d44-e1b8-4a08-a66c-e37120334a30 req-5098bb9e-3063-4422-aa66-7a744043d04d service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:45.372737 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-d9aa7d44-e1b8-4a08-a66c-e37120334a30 req-5098bb9e-3063-4422-aa66-7a744043d04d service nova] Creating event network-vif-plugged:68faecf3-5b76-4ea3-b631-30ac4f8a4592 for instance 2bae6994-d651-45c7-955b-13df805da49f on hv-cinder-85391 Aug 30 05:12:45.379884 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-d9aa7d44-e1b8-4a08-a66c-e37120334a30 req-5098bb9e-3063-4422-aa66-7a744043d04d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109139 Aug 30 05:12:45.380843 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 60/122] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:12:45.403142 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-113aa9fa-f798-47c8-b600-4fca5b29e2bc tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:45.411245 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-113aa9fa-f798-47c8-b600-4fca5b29e2bc tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.194369 Aug 30 05:12:45.411824 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 63/123] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:45 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:45.727643 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4ceb41b4-1595-47f1-b8ee-4ce4f28cefb4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:45.728574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4ceb41b4-1595-47f1-b8ee-4ce4f28cefb4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:45.739873 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ceb41b4-1595-47f1-b8ee-4ce4f28cefb4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:45.742895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ceb41b4-1595-47f1-b8ee-4ce4f28cefb4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:45.743549 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ceb41b4-1595-47f1-b8ee-4ce4f28cefb4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:45.744274 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ceb41b4-1595-47f1-b8ee-4ce4f28cefb4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:45.751504 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ceb41b4-1595-47f1-b8ee-4ce4f28cefb4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:45.752194 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4ceb41b4-1595-47f1-b8ee-4ce4f28cefb4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:45.798120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-09841246-1bae-4ad8-8bee-6b1112d65029 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:45.799644 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-09841246-1bae-4ad8-8bee-6b1112d65029 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:45.805756 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09841246-1bae-4ad8-8bee-6b1112d65029 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:45.810996 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09841246-1bae-4ad8-8bee-6b1112d65029 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:45.811452 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09841246-1bae-4ad8-8bee-6b1112d65029 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:45.812207 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09841246-1bae-4ad8-8bee-6b1112d65029 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:45.812723 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09841246-1bae-4ad8-8bee-6b1112d65029 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:45.813144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09841246-1bae-4ad8-8bee-6b1112d65029 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:45.988689 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-09841246-1bae-4ad8-8bee-6b1112d65029 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:45.996899 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-09841246-1bae-4ad8-8bee-6b1112d65029 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:45.999201 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-09841246-1bae-4ad8-8bee-6b1112d65029 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:46.001266 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-09841246-1bae-4ad8-8bee-6b1112d65029 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1407 microversion: 2.20 time: 0.207091 Aug 30 05:12:46.002019 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 64/124] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:45 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:46.059625 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4ceb41b4-1595-47f1-b8ee-4ce4f28cefb4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:46.068151 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4ceb41b4-1595-47f1-b8ee-4ce4f28cefb4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1361 microversion: 2.1 time: 0.344613 Aug 30 05:12:46.083941 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 61/125] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:45 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1361 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:46.138697 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e847cf51-6358-424f-a334-d79e08235f64 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:46.140771 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e847cf51-6358-424f-a334-d79e08235f64 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:46.150434 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e847cf51-6358-424f-a334-d79e08235f64 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:46.151811 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e847cf51-6358-424f-a334-d79e08235f64 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:46.152470 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e847cf51-6358-424f-a334-d79e08235f64 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:46.153490 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e847cf51-6358-424f-a334-d79e08235f64 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:46.154184 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e847cf51-6358-424f-a334-d79e08235f64 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:46.154662 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e847cf51-6358-424f-a334-d79e08235f64 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:46.437407 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e7caf6b9-ab7f-427d-aff0-28e030dcb8e5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:46.439651 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e7caf6b9-ab7f-427d-aff0-28e030dcb8e5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:46.491377 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e7caf6b9-ab7f-427d-aff0-28e030dcb8e5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:46.492602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e7caf6b9-ab7f-427d-aff0-28e030dcb8e5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:46.493634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e7caf6b9-ab7f-427d-aff0-28e030dcb8e5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:46.495591 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e7caf6b9-ab7f-427d-aff0-28e030dcb8e5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:46.496728 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e7caf6b9-ab7f-427d-aff0-28e030dcb8e5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:46.497672 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e7caf6b9-ab7f-427d-aff0-28e030dcb8e5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:46.517243 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e847cf51-6358-424f-a334-d79e08235f64 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:46.552971 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e847cf51-6358-424f-a334-d79e08235f64 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1321 microversion: 2.1 time: 0.412265 Aug 30 05:12:46.554249 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 65/126] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:46 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1321 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:46.736854 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e7caf6b9-ab7f-427d-aff0-28e030dcb8e5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:46.746315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e7caf6b9-ab7f-427d-aff0-28e030dcb8e5 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.317648 Aug 30 05:12:46.747451 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 62/127] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:46 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:47.025153 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2659c252-5677-4587-b1d9-907539e85586 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:47.026285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2659c252-5677-4587-b1d9-907539e85586 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:47.038910 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2659c252-5677-4587-b1d9-907539e85586 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:47.040070 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2659c252-5677-4587-b1d9-907539e85586 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:47.040677 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2659c252-5677-4587-b1d9-907539e85586 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:47.042579 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2659c252-5677-4587-b1d9-907539e85586 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:47.043115 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2659c252-5677-4587-b1d9-907539e85586 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:47.043680 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2659c252-5677-4587-b1d9-907539e85586 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:47.094671 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ef858359-d6b7-4cc3-b47a-9e54e6c930db tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:47.095566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ef858359-d6b7-4cc3-b47a-9e54e6c930db tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:47.107703 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef858359-d6b7-4cc3-b47a-9e54e6c930db tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:47.108720 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef858359-d6b7-4cc3-b47a-9e54e6c930db tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:47.110853 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef858359-d6b7-4cc3-b47a-9e54e6c930db tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:47.112287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef858359-d6b7-4cc3-b47a-9e54e6c930db tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:47.113495 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef858359-d6b7-4cc3-b47a-9e54e6c930db tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:47.115119 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef858359-d6b7-4cc3-b47a-9e54e6c930db tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:47.230741 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2659c252-5677-4587-b1d9-907539e85586 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:47.242648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2659c252-5677-4587-b1d9-907539e85586 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:47.245146 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2659c252-5677-4587-b1d9-907539e85586 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:47.251928 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2659c252-5677-4587-b1d9-907539e85586 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1407 microversion: 2.20 time: 0.230568 Aug 30 05:12:47.253446 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 66/128] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:47 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:47.316378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ef858359-d6b7-4cc3-b47a-9e54e6c930db tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:47.326094 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ef858359-d6b7-4cc3-b47a-9e54e6c930db tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1361 microversion: 2.1 time: 0.236842 Aug 30 05:12:47.326972 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 63/129] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:47 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:47.403468 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-2ed35a48-4b15-481a-b442-44e57be65e6e req-8df60bee-9c60-45ae-a551-ff8ad27b6ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ec17dd-c9e2-4802-86c7-f985a04be891", "name": "network-vif-plugged", "status": "completed", "tag": "3231ee58-a276-4f6a-a338-703b3e38ed84"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:47.415509 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2ed35a48-4b15-481a-b442-44e57be65e6e req-8df60bee-9c60-45ae-a551-ff8ad27b6ec2 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:47.415991 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2ed35a48-4b15-481a-b442-44e57be65e6e req-8df60bee-9c60-45ae-a551-ff8ad27b6ec2 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:47.416426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2ed35a48-4b15-481a-b442-44e57be65e6e req-8df60bee-9c60-45ae-a551-ff8ad27b6ec2 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:47.431091 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-2ed35a48-4b15-481a-b442-44e57be65e6e req-8df60bee-9c60-45ae-a551-ff8ad27b6ec2 service nova] Creating event network-vif-plugged:3231ee58-a276-4f6a-a338-703b3e38ed84 for instance e0ec17dd-c9e2-4802-86c7-f985a04be891 on hv-cinder-85391 Aug 30 05:12:47.438736 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-2ed35a48-4b15-481a-b442-44e57be65e6e req-8df60bee-9c60-45ae-a551-ff8ad27b6ec2 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040443 Aug 30 05:12:47.439885 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 67/130] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:12:47.580416 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c784ad47-932f-4a74-b36b-0b6c50a27a54 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:47.581398 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c784ad47-932f-4a74-b36b-0b6c50a27a54 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:47.591408 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c784ad47-932f-4a74-b36b-0b6c50a27a54 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:47.592456 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c784ad47-932f-4a74-b36b-0b6c50a27a54 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:47.593081 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c784ad47-932f-4a74-b36b-0b6c50a27a54 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:47.594133 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c784ad47-932f-4a74-b36b-0b6c50a27a54 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:47.596114 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c784ad47-932f-4a74-b36b-0b6c50a27a54 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:47.597473 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c784ad47-932f-4a74-b36b-0b6c50a27a54 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:47.768169 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c2126d57-4da3-47be-bef7-4c02d0a64d6f tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:47.768877 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c2126d57-4da3-47be-bef7-4c02d0a64d6f tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:47.776459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2126d57-4da3-47be-bef7-4c02d0a64d6f tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:47.777138 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2126d57-4da3-47be-bef7-4c02d0a64d6f tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:47.777728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2126d57-4da3-47be-bef7-4c02d0a64d6f tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:47.779479 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2126d57-4da3-47be-bef7-4c02d0a64d6f tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:47.780346 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2126d57-4da3-47be-bef7-4c02d0a64d6f tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:47.780936 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c2126d57-4da3-47be-bef7-4c02d0a64d6f tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:48.005270 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c784ad47-932f-4a74-b36b-0b6c50a27a54 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:48.015303 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c2126d57-4da3-47be-bef7-4c02d0a64d6f tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:48.028623 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c2126d57-4da3-47be-bef7-4c02d0a64d6f tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1315 microversion: 2.1 time: 0.262021 Aug 30 05:12:48.029427 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 68/131] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:47 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:48.035410 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c784ad47-932f-4a74-b36b-0b6c50a27a54 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1321 microversion: 2.1 time: 0.459750 Aug 30 05:12:48.048087 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 64/132] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:47 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1321 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:48.276198 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a1fbabe7-5008-40a9-8dff-2d3ec5a93833 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:48.277179 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a1fbabe7-5008-40a9-8dff-2d3ec5a93833 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:48.290697 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1fbabe7-5008-40a9-8dff-2d3ec5a93833 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:48.293703 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1fbabe7-5008-40a9-8dff-2d3ec5a93833 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:48.294175 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1fbabe7-5008-40a9-8dff-2d3ec5a93833 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:48.298112 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1fbabe7-5008-40a9-8dff-2d3ec5a93833 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:48.298911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1fbabe7-5008-40a9-8dff-2d3ec5a93833 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:48.300266 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a1fbabe7-5008-40a9-8dff-2d3ec5a93833 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:48.348194 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c97d4ebe-e469-4061-85fd-5954654a960b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:48.348844 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c97d4ebe-e469-4061-85fd-5954654a960b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:48.356150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c97d4ebe-e469-4061-85fd-5954654a960b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:48.356857 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c97d4ebe-e469-4061-85fd-5954654a960b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:48.357493 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c97d4ebe-e469-4061-85fd-5954654a960b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:48.360388 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c97d4ebe-e469-4061-85fd-5954654a960b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:48.362379 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c97d4ebe-e469-4061-85fd-5954654a960b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:48.365502 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c97d4ebe-e469-4061-85fd-5954654a960b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:48.557516 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a1fbabe7-5008-40a9-8dff-2d3ec5a93833 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:48.574918 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c97d4ebe-e469-4061-85fd-5954654a960b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:48.586961 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c97d4ebe-e469-4061-85fd-5954654a960b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1361 microversion: 2.1 time: 0.241291 Aug 30 05:12:48.588131 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 65/133] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:48 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:48.588603 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a1fbabe7-5008-40a9-8dff-2d3ec5a93833 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:48.595122 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a1fbabe7-5008-40a9-8dff-2d3ec5a93833 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:48.595122 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a1fbabe7-5008-40a9-8dff-2d3ec5a93833 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1407 microversion: 2.20 time: 0.320871 Aug 30 05:12:48.595122 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 69/134] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:48 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:49.056843 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fb750f65-40e4-48f2-9cf2-6301e221f106 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:49.057465 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fb750f65-40e4-48f2-9cf2-6301e221f106 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:49.058157 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-744e14b9-2d74-4ac0-af61-91c0d9a2c43b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:49.058764 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-744e14b9-2d74-4ac0-af61-91c0d9a2c43b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:49.070939 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb750f65-40e4-48f2-9cf2-6301e221f106 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:49.075035 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-744e14b9-2d74-4ac0-af61-91c0d9a2c43b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:49.078856 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb750f65-40e4-48f2-9cf2-6301e221f106 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:49.079367 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb750f65-40e4-48f2-9cf2-6301e221f106 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:49.080270 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-744e14b9-2d74-4ac0-af61-91c0d9a2c43b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:49.080865 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-744e14b9-2d74-4ac0-af61-91c0d9a2c43b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:49.083116 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb750f65-40e4-48f2-9cf2-6301e221f106 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:49.083613 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb750f65-40e4-48f2-9cf2-6301e221f106 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:49.084049 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb750f65-40e4-48f2-9cf2-6301e221f106 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:49.088628 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-744e14b9-2d74-4ac0-af61-91c0d9a2c43b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:49.089187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-744e14b9-2d74-4ac0-af61-91c0d9a2c43b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:49.090570 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-744e14b9-2d74-4ac0-af61-91c0d9a2c43b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:49.315664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fb750f65-40e4-48f2-9cf2-6301e221f106 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:49.325853 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fb750f65-40e4-48f2-9cf2-6301e221f106 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1503 microversion: 2.1 time: 0.279592 Aug 30 05:12:49.328193 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 66/135] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:49 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1503 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:49.366983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-744e14b9-2d74-4ac0-af61-91c0d9a2c43b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:49.377311 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-744e14b9-2d74-4ac0-af61-91c0d9a2c43b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1321 microversion: 2.1 time: 0.324860 Aug 30 05:12:49.388712 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 70/136] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:49 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:49.477486 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-34b4892b-0398-4144-b85a-28980c2f173a req-8aef94e9-9e50-419d-973a-49564b729a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f83c589-3a23-45aa-96c5-3cf9006b3830", "name": "network-vif-plugged", "status": "completed", "tag": "c5da19b6-98a0-4af9-b8f5-52291d4a9be0"}, {"server_uuid": "2a54dc6f-8cee-4b66-9486-491841d01c27", "name": "network-vif-plugged", "status": "completed", "tag": "a8fa1465-9fa9-4b85-9370-89b6902a982d"}, {"server_uuid": "43143409-91ae-49e1-a4d3-688ea54d1d0b", "name": "network-vif-plugged", "status": "completed", "tag": "04285150-7904-4555-9230-fcb76ec2800d"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:49.494343 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-34b4892b-0398-4144-b85a-28980c2f173a req-8aef94e9-9e50-419d-973a-49564b729a6f service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:49.498781 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-34b4892b-0398-4144-b85a-28980c2f173a req-8aef94e9-9e50-419d-973a-49564b729a6f service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:49.499452 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-34b4892b-0398-4144-b85a-28980c2f173a req-8aef94e9-9e50-419d-973a-49564b729a6f service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:49.530425 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-34b4892b-0398-4144-b85a-28980c2f173a req-8aef94e9-9e50-419d-973a-49564b729a6f service nova] Creating event network-vif-plugged:c5da19b6-98a0-4af9-b8f5-52291d4a9be0 for instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 on hv-cinder-85391 Aug 30 05:12:49.533501 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-34b4892b-0398-4144-b85a-28980c2f173a req-8aef94e9-9e50-419d-973a-49564b729a6f service nova] Creating event network-vif-plugged:a8fa1465-9fa9-4b85-9370-89b6902a982d for instance 2a54dc6f-8cee-4b66-9486-491841d01c27 on hv-cinder-85391 Aug 30 05:12:49.537056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-34b4892b-0398-4144-b85a-28980c2f173a req-8aef94e9-9e50-419d-973a-49564b729a6f service nova] Creating event network-vif-plugged:04285150-7904-4555-9230-fcb76ec2800d for instance 43143409-91ae-49e1-a4d3-688ea54d1d0b on hv-cinder-85391 Aug 30 05:12:49.555640 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-34b4892b-0398-4144-b85a-28980c2f173a req-8aef94e9-9e50-419d-973a-49564b729a6f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.081787 Aug 30 05:12:49.566097 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 67/137] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:12:49.614110 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2336dc02-ef56-462f-976f-f1745c5f9b19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:49.614975 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2336dc02-ef56-462f-976f-f1745c5f9b19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:49.621548 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8039b95c-0f4d-4e29-ac66-59cc07d145f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:49.622725 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8039b95c-0f4d-4e29-ac66-59cc07d145f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:49.631221 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8039b95c-0f4d-4e29-ac66-59cc07d145f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:49.631738 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8039b95c-0f4d-4e29-ac66-59cc07d145f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:49.632327 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8039b95c-0f4d-4e29-ac66-59cc07d145f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:49.634914 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8039b95c-0f4d-4e29-ac66-59cc07d145f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:49.635557 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8039b95c-0f4d-4e29-ac66-59cc07d145f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:49.636210 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8039b95c-0f4d-4e29-ac66-59cc07d145f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:49.642869 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2336dc02-ef56-462f-976f-f1745c5f9b19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:49.644336 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2336dc02-ef56-462f-976f-f1745c5f9b19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:49.644790 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2336dc02-ef56-462f-976f-f1745c5f9b19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:49.649656 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2336dc02-ef56-462f-976f-f1745c5f9b19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:49.651322 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2336dc02-ef56-462f-976f-f1745c5f9b19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:49.652983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2336dc02-ef56-462f-976f-f1745c5f9b19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:49.905025 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8039b95c-0f4d-4e29-ac66-59cc07d145f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:49.918368 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8039b95c-0f4d-4e29-ac66-59cc07d145f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:49.921712 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8039b95c-0f4d-4e29-ac66-59cc07d145f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:49.924003 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8039b95c-0f4d-4e29-ac66-59cc07d145f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1407 microversion: 2.20 time: 0.309183 Aug 30 05:12:49.938956 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 68/138] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:49 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:12:49.953115 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2336dc02-ef56-462f-976f-f1745c5f9b19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:49.977673 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2336dc02-ef56-462f-976f-f1745c5f9b19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1361 microversion: 2.1 time: 0.368378 Aug 30 05:12:49.984303 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 71/139] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:49 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1361 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:50.404078 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b298a2a1-2f82-495b-8a1a-29fc55a9825e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:50.404078 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b298a2a1-2f82-495b-8a1a-29fc55a9825e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:50.408378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b298a2a1-2f82-495b-8a1a-29fc55a9825e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:50.409417 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b298a2a1-2f82-495b-8a1a-29fc55a9825e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:50.409856 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b298a2a1-2f82-495b-8a1a-29fc55a9825e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:50.410553 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b298a2a1-2f82-495b-8a1a-29fc55a9825e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:50.411034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b298a2a1-2f82-495b-8a1a-29fc55a9825e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:50.411452 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b298a2a1-2f82-495b-8a1a-29fc55a9825e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:50.623050 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b298a2a1-2f82-495b-8a1a-29fc55a9825e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:50.632610 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b298a2a1-2f82-495b-8a1a-29fc55a9825e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1321 microversion: 2.1 time: 0.237160 Aug 30 05:12:50.633648 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 69/140] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:50 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:50.949749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ea2753e6-276c-47b6-8a3d-200f1c7b8714 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:50.950437 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ea2753e6-276c-47b6-8a3d-200f1c7b8714 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:50.957394 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea2753e6-276c-47b6-8a3d-200f1c7b8714 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:50.957950 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea2753e6-276c-47b6-8a3d-200f1c7b8714 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:50.958454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea2753e6-276c-47b6-8a3d-200f1c7b8714 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:50.959250 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea2753e6-276c-47b6-8a3d-200f1c7b8714 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:50.959868 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea2753e6-276c-47b6-8a3d-200f1c7b8714 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:50.960322 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ea2753e6-276c-47b6-8a3d-200f1c7b8714 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:51.010839 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7c9be4b1-ec1b-417d-8299-de31b6d70cb3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:51.011617 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7c9be4b1-ec1b-417d-8299-de31b6d70cb3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:51.017670 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c9be4b1-ec1b-417d-8299-de31b6d70cb3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:51.018934 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c9be4b1-ec1b-417d-8299-de31b6d70cb3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:51.019433 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c9be4b1-ec1b-417d-8299-de31b6d70cb3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:51.020285 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c9be4b1-ec1b-417d-8299-de31b6d70cb3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:51.020805 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c9be4b1-ec1b-417d-8299-de31b6d70cb3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:51.021300 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c9be4b1-ec1b-417d-8299-de31b6d70cb3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:51.120828 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ea2753e6-276c-47b6-8a3d-200f1c7b8714 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:51.129531 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ea2753e6-276c-47b6-8a3d-200f1c7b8714 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:51.131193 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ea2753e6-276c-47b6-8a3d-200f1c7b8714 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:51.132501 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ea2753e6-276c-47b6-8a3d-200f1c7b8714 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1407 microversion: 2.20 time: 0.187069 Aug 30 05:12:51.133249 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 72/141] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:50 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:51.180627 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7c9be4b1-ec1b-417d-8299-de31b6d70cb3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:51.188284 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7c9be4b1-ec1b-417d-8299-de31b6d70cb3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1361 microversion: 2.1 time: 0.184299 Aug 30 05:12:51.189609 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 70/142] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:51 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:51.664355 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3fd5e2d8-428f-422f-bc2f-d5cd200fcaa9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:51.664355 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3fd5e2d8-428f-422f-bc2f-d5cd200fcaa9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:51.664355 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fd5e2d8-428f-422f-bc2f-d5cd200fcaa9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:51.664355 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fd5e2d8-428f-422f-bc2f-d5cd200fcaa9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:51.664735 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fd5e2d8-428f-422f-bc2f-d5cd200fcaa9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:51.664735 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fd5e2d8-428f-422f-bc2f-d5cd200fcaa9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:51.664735 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fd5e2d8-428f-422f-bc2f-d5cd200fcaa9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:51.664735 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3fd5e2d8-428f-422f-bc2f-d5cd200fcaa9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:51.822251 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3fd5e2d8-428f-422f-bc2f-d5cd200fcaa9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:51.829895 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3fd5e2d8-428f-422f-bc2f-d5cd200fcaa9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1321 microversion: 2.1 time: 0.180125 Aug 30 05:12:51.842871 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 73/143] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:51 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:52.155793 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e813cc72-2cd4-45f7-bfc9-f6fd5b2092ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:52.156401 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e813cc72-2cd4-45f7-bfc9-f6fd5b2092ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:52.158357 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=97 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:52.163959 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e813cc72-2cd4-45f7-bfc9-f6fd5b2092ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:52.164450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e813cc72-2cd4-45f7-bfc9-f6fd5b2092ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:52.164882 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e813cc72-2cd4-45f7-bfc9-f6fd5b2092ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:52.165664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e813cc72-2cd4-45f7-bfc9-f6fd5b2092ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:52.166148 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e813cc72-2cd4-45f7-bfc9-f6fd5b2092ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:52.166569 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e813cc72-2cd4-45f7-bfc9-f6fd5b2092ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:52.211844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fcd088de-b46e-47ea-9b89-5380d0ed1305 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:52.212841 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fcd088de-b46e-47ea-9b89-5380d0ed1305 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:52.219117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcd088de-b46e-47ea-9b89-5380d0ed1305 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:52.219918 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcd088de-b46e-47ea-9b89-5380d0ed1305 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:52.220445 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcd088de-b46e-47ea-9b89-5380d0ed1305 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:52.221711 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcd088de-b46e-47ea-9b89-5380d0ed1305 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:52.222243 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcd088de-b46e-47ea-9b89-5380d0ed1305 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:52.222730 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fcd088de-b46e-47ea-9b89-5380d0ed1305 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:52.334398 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e813cc72-2cd4-45f7-bfc9-f6fd5b2092ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:52.345745 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e813cc72-2cd4-45f7-bfc9-f6fd5b2092ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:52.347868 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e813cc72-2cd4-45f7-bfc9-f6fd5b2092ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:52.349202 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e813cc72-2cd4-45f7-bfc9-f6fd5b2092ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1407 microversion: 2.20 time: 0.197334 Aug 30 05:12:52.349768 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 71/144] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:52 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:52.363305 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fcd088de-b46e-47ea-9b89-5380d0ed1305 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:52.371066 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fcd088de-b46e-47ea-9b89-5380d0ed1305 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1361 microversion: 2.1 time: 0.163101 Aug 30 05:12:52.371631 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 74/145] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:52 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:52.851871 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-73825de1-2745-48a1-bd57-12e795b385a3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:52.852486 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-73825de1-2745-48a1-bd57-12e795b385a3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:52.861120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73825de1-2745-48a1-bd57-12e795b385a3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:52.861628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73825de1-2745-48a1-bd57-12e795b385a3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:52.862044 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73825de1-2745-48a1-bd57-12e795b385a3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:52.862749 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73825de1-2745-48a1-bd57-12e795b385a3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:52.863236 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73825de1-2745-48a1-bd57-12e795b385a3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:52.863662 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-73825de1-2745-48a1-bd57-12e795b385a3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:53.006430 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-73825de1-2745-48a1-bd57-12e795b385a3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:53.025540 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-73825de1-2745-48a1-bd57-12e795b385a3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1321 microversion: 2.1 time: 0.177490 Aug 30 05:12:53.037809 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 72/146] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:52 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:53.372817 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8c52f5c5-a5a2-44d2-a062-8c17e6ebe8ed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:53.373496 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8c52f5c5-a5a2-44d2-a062-8c17e6ebe8ed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:53.376518 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:53.381055 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c52f5c5-a5a2-44d2-a062-8c17e6ebe8ed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:53.381541 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c52f5c5-a5a2-44d2-a062-8c17e6ebe8ed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:53.381966 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c52f5c5-a5a2-44d2-a062-8c17e6ebe8ed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:53.382648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c52f5c5-a5a2-44d2-a062-8c17e6ebe8ed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:53.383113 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c52f5c5-a5a2-44d2-a062-8c17e6ebe8ed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:53.383529 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c52f5c5-a5a2-44d2-a062-8c17e6ebe8ed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:53.391086 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9c7f65cd-d642-4bb3-9406-0de25f70fa00 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:53.391644 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9c7f65cd-d642-4bb3-9406-0de25f70fa00 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:53.397940 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c7f65cd-d642-4bb3-9406-0de25f70fa00 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:53.398606 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c7f65cd-d642-4bb3-9406-0de25f70fa00 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:53.399210 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c7f65cd-d642-4bb3-9406-0de25f70fa00 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:53.400287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c7f65cd-d642-4bb3-9406-0de25f70fa00 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:53.400849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c7f65cd-d642-4bb3-9406-0de25f70fa00 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:53.401299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c7f65cd-d642-4bb3-9406-0de25f70fa00 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:53.405828 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:53.541899 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8c52f5c5-a5a2-44d2-a062-8c17e6ebe8ed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:53.555055 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8c52f5c5-a5a2-44d2-a062-8c17e6ebe8ed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:53.556658 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8c52f5c5-a5a2-44d2-a062-8c17e6ebe8ed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:53.558088 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8c52f5c5-a5a2-44d2-a062-8c17e6ebe8ed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1407 microversion: 2.20 time: 0.189087 Aug 30 05:12:53.559520 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 75/147] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:53 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:53.569463 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9c7f65cd-d642-4bb3-9406-0de25f70fa00 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:53.578026 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9c7f65cd-d642-4bb3-9406-0de25f70fa00 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1361 microversion: 2.1 time: 0.190833 Aug 30 05:12:53.578597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 73/148] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:53 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:54.048982 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dd83fd01-9b8a-4603-a927-314ffe0d3714 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:54.049767 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dd83fd01-9b8a-4603-a927-314ffe0d3714 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:54.056152 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd83fd01-9b8a-4603-a927-314ffe0d3714 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:54.056765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd83fd01-9b8a-4603-a927-314ffe0d3714 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:54.057218 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd83fd01-9b8a-4603-a927-314ffe0d3714 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:54.058144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd83fd01-9b8a-4603-a927-314ffe0d3714 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:54.058782 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd83fd01-9b8a-4603-a927-314ffe0d3714 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:54.059367 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd83fd01-9b8a-4603-a927-314ffe0d3714 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:54.221826 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dd83fd01-9b8a-4603-a927-314ffe0d3714 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:54.229482 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dd83fd01-9b8a-4603-a927-314ffe0d3714 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1321 microversion: 2.1 time: 0.184673 Aug 30 05:12:54.230040 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 76/149] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:54 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:54.420230 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eb793e4f-2f35-4a52-badb-a7d4ecc052ff tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aea471f1-3e6c-43de-970e-c022cdb6101d"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:54.423150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eb793e4f-2f35-4a52-badb-a7d4ecc052ff tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:54.431575 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb793e4f-2f35-4a52-badb-a7d4ecc052ff tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:54.432324 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb793e4f-2f35-4a52-badb-a7d4ecc052ff tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:54.433776 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb793e4f-2f35-4a52-badb-a7d4ecc052ff tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:54.434678 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb793e4f-2f35-4a52-badb-a7d4ecc052ff tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:54.435397 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb793e4f-2f35-4a52-badb-a7d4ecc052ff tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:54.436172 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb793e4f-2f35-4a52-badb-a7d4ecc052ff tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:54.585515 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cd96fb59-2fb1-4ea2-ae60-fc361bb6f881 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:54.586126 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cd96fb59-2fb1-4ea2-ae60-fc361bb6f881 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:54.592730 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd96fb59-2fb1-4ea2-ae60-fc361bb6f881 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:54.593416 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd96fb59-2fb1-4ea2-ae60-fc361bb6f881 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:54.594094 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd96fb59-2fb1-4ea2-ae60-fc361bb6f881 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:54.595085 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd96fb59-2fb1-4ea2-ae60-fc361bb6f881 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:54.595548 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd96fb59-2fb1-4ea2-ae60-fc361bb6f881 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:54.595976 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd96fb59-2fb1-4ea2-ae60-fc361bb6f881 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:54.778469 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cd96fb59-2fb1-4ea2-ae60-fc361bb6f881 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:54.789900 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cd96fb59-2fb1-4ea2-ae60-fc361bb6f881 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:54.791963 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cd96fb59-2fb1-4ea2-ae60-fc361bb6f881 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:54.793357 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cd96fb59-2fb1-4ea2-ae60-fc361bb6f881 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1407 microversion: 2.20 time: 0.212319 Aug 30 05:12:54.794796 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 77/150] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:54 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:12:54.810795 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5b146e49-a1fb-4283-9104-43e2249deae3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:54.811748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5b146e49-a1fb-4283-9104-43e2249deae3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:54.818986 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b146e49-a1fb-4283-9104-43e2249deae3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:54.819659 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b146e49-a1fb-4283-9104-43e2249deae3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:54.820588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b146e49-a1fb-4283-9104-43e2249deae3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:54.821655 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b146e49-a1fb-4283-9104-43e2249deae3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:54.822674 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b146e49-a1fb-4283-9104-43e2249deae3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:54.823351 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b146e49-a1fb-4283-9104-43e2249deae3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:55.064690 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5b146e49-a1fb-4283-9104-43e2249deae3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:55.073599 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5b146e49-a1fb-4283-9104-43e2249deae3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1361 microversion: 2.1 time: 0.277732 Aug 30 05:12:55.074201 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 78/151] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:54 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:55.253007 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7a004953-8e22-4955-b3b3-e681822a3062 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:55.253753 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7a004953-8e22-4955-b3b3-e681822a3062 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:55.260571 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a004953-8e22-4955-b3b3-e681822a3062 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:55.261058 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a004953-8e22-4955-b3b3-e681822a3062 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:55.261488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a004953-8e22-4955-b3b3-e681822a3062 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:55.262200 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a004953-8e22-4955-b3b3-e681822a3062 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:55.262648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a004953-8e22-4955-b3b3-e681822a3062 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:55.263089 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7a004953-8e22-4955-b3b3-e681822a3062 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:55.407935 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7a004953-8e22-4955-b3b3-e681822a3062 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:55.420960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7a004953-8e22-4955-b3b3-e681822a3062 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1516 microversion: 2.1 time: 0.171435 Aug 30 05:12:55.435490 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 79/152] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:55 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1516 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:55.443749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-db860fc5-e1cd-4193-845a-c4cbd1ab565e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:55.446760 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-db860fc5-e1cd-4193-845a-c4cbd1ab565e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:55.453669 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db860fc5-e1cd-4193-845a-c4cbd1ab565e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:55.454402 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db860fc5-e1cd-4193-845a-c4cbd1ab565e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:55.455053 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db860fc5-e1cd-4193-845a-c4cbd1ab565e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:55.456118 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db860fc5-e1cd-4193-845a-c4cbd1ab565e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:55.456721 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db860fc5-e1cd-4193-845a-c4cbd1ab565e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:55.457293 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-db860fc5-e1cd-4193-845a-c4cbd1ab565e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:55.528770 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-db860fc5-e1cd-4193-845a-c4cbd1ab565e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lazy-loading 'flavor' on Instance uuid 43143409-91ae-49e1-a4d3-688ea54d1d0b {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:12:55.677184 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-db860fc5-e1cd-4193-845a-c4cbd1ab565e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "POST /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b/action" status: 200 len: 32 microversion: 2.1 time: 0.237650 Aug 30 05:12:55.677785 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 80/153] 10.222.0.77 () {60 vars in 1278 bytes} [Tue Aug 30 05:12:55 2022] POST /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b/action => generated 32 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 05:12:55.687510 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f04f4253-b65e-4ec3-9fa5-994cd651f66e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:55.688209 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f04f4253-b65e-4ec3-9fa5-994cd651f66e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:55.694212 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f04f4253-b65e-4ec3-9fa5-994cd651f66e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:55.694738 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f04f4253-b65e-4ec3-9fa5-994cd651f66e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:55.695315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f04f4253-b65e-4ec3-9fa5-994cd651f66e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:55.696091 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f04f4253-b65e-4ec3-9fa5-994cd651f66e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:55.696624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f04f4253-b65e-4ec3-9fa5-994cd651f66e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:55.697103 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f04f4253-b65e-4ec3-9fa5-994cd651f66e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:55.851250 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f04f4253-b65e-4ec3-9fa5-994cd651f66e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:55.858777 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f04f4253-b65e-4ec3-9fa5-994cd651f66e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.175275 Aug 30 05:12:55.859364 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 81/154] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:55 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:55.872278 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f43a2a62-76ca-43ae-9c17-4f34396031e1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:55.872278 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f43a2a62-76ca-43ae-9c17-4f34396031e1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:55.872278 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f43a2a62-76ca-43ae-9c17-4f34396031e1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:55.872278 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f43a2a62-76ca-43ae-9c17-4f34396031e1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:55.872773 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f43a2a62-76ca-43ae-9c17-4f34396031e1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:55.872773 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f43a2a62-76ca-43ae-9c17-4f34396031e1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:55.872773 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f43a2a62-76ca-43ae-9c17-4f34396031e1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:55.872958 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f43a2a62-76ca-43ae-9c17-4f34396031e1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:56.112646 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f43a2a62-76ca-43ae-9c17-4f34396031e1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:56.122744 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f43a2a62-76ca-43ae-9c17-4f34396031e1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:56.124617 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f43a2a62-76ca-43ae-9c17-4f34396031e1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:56.125850 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f43a2a62-76ca-43ae-9c17-4f34396031e1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1599 microversion: 2.20 time: 0.265562 Aug 30 05:12:56.126509 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 82/155] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:12:55 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1599 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:12:56.132163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ef0ccd4c-5714-4d72-bea0-296954faf8a7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:56.132856 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ef0ccd4c-5714-4d72-bea0-296954faf8a7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:56.145650 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef0ccd4c-5714-4d72-bea0-296954faf8a7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:56.147356 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef0ccd4c-5714-4d72-bea0-296954faf8a7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:56.149324 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef0ccd4c-5714-4d72-bea0-296954faf8a7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:56.150102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef0ccd4c-5714-4d72-bea0-296954faf8a7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:56.152447 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef0ccd4c-5714-4d72-bea0-296954faf8a7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:56.152896 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ef0ccd4c-5714-4d72-bea0-296954faf8a7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:56.261734 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:56.345007 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eb793e4f-2f35-4a52-badb-a7d4ecc052ff tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "POST /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.928997 Aug 30 05:12:56.345659 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 74/156] 10.222.0.77 () {60 vars in 1323 bytes} [Tue Aug 30 05:12:54 2022] POST /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f/os-volume_attachments => generated 194 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:12:56.362640 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-efa533b8-87cf-431c-ba1b-4de6ae75e8e7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:56.383324 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-efa533b8-87cf-431c-ba1b-4de6ae75e8e7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:56.410030 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-efa533b8-87cf-431c-ba1b-4de6ae75e8e7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:56.412091 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-efa533b8-87cf-431c-ba1b-4de6ae75e8e7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:56.413383 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-efa533b8-87cf-431c-ba1b-4de6ae75e8e7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:56.415842 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-efa533b8-87cf-431c-ba1b-4de6ae75e8e7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:56.416388 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-efa533b8-87cf-431c-ba1b-4de6ae75e8e7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:56.431596 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-efa533b8-87cf-431c-ba1b-4de6ae75e8e7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:56.434281 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ef0ccd4c-5714-4d72-bea0-296954faf8a7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:56.476570 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ef0ccd4c-5714-4d72-bea0-296954faf8a7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1547 microversion: 2.1 time: 0.348974 Aug 30 05:12:56.477926 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 83/157] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:56 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1547 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:56.504457 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-da03723d-1535-46c6-85d1-db6f95884020 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:56.510782 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-da03723d-1535-46c6-85d1-db6f95884020 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:56.539184 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da03723d-1535-46c6-85d1-db6f95884020 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:56.539184 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da03723d-1535-46c6-85d1-db6f95884020 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:56.539184 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da03723d-1535-46c6-85d1-db6f95884020 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:56.541081 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da03723d-1535-46c6-85d1-db6f95884020 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:56.542710 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da03723d-1535-46c6-85d1-db6f95884020 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:56.543222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da03723d-1535-46c6-85d1-db6f95884020 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:56.590742 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-efa533b8-87cf-431c-ba1b-4de6ae75e8e7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.239722 Aug 30 05:12:56.591723 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 75/158] 10.222.0.77 () {60 vars in 1316 bytes} [Tue Aug 30 05:12:56 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/os-interface => generated 285 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:12:56.656954 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-da03723d-1535-46c6-85d1-db6f95884020 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161107 Aug 30 05:12:56.657634 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 84/159] 10.222.0.77 () {58 vars in 1275 bytes} [Tue Aug 30 05:12:56 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/os-interface => generated 285 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:12:56.883253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3544d2ad-8c16-46de-b711-dcec653a8650 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:56.883898 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3544d2ad-8c16-46de-b711-dcec653a8650 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:56.903733 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3544d2ad-8c16-46de-b711-dcec653a8650 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:56.904239 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3544d2ad-8c16-46de-b711-dcec653a8650 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:56.904682 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3544d2ad-8c16-46de-b711-dcec653a8650 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:56.905397 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3544d2ad-8c16-46de-b711-dcec653a8650 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:56.905860 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3544d2ad-8c16-46de-b711-dcec653a8650 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:56.907483 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3544d2ad-8c16-46de-b711-dcec653a8650 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:57.355667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3544d2ad-8c16-46de-b711-dcec653a8650 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:57.367343 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3544d2ad-8c16-46de-b711-dcec653a8650 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.492127 Aug 30 05:12:57.382063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 76/160] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:56 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:58.388442 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f2043c15-488e-41fd-bc46-4500d65c4ba2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:58.389628 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f2043c15-488e-41fd-bc46-4500d65c4ba2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:58.396137 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2043c15-488e-41fd-bc46-4500d65c4ba2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:58.396594 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2043c15-488e-41fd-bc46-4500d65c4ba2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:58.397045 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2043c15-488e-41fd-bc46-4500d65c4ba2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:58.398087 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2043c15-488e-41fd-bc46-4500d65c4ba2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:58.398692 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2043c15-488e-41fd-bc46-4500d65c4ba2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:58.399309 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f2043c15-488e-41fd-bc46-4500d65c4ba2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:58.661403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f2043c15-488e-41fd-bc46-4500d65c4ba2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:58.675060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f2043c15-488e-41fd-bc46-4500d65c4ba2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.290236 Aug 30 05:12:58.676555 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 85/161] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:58 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:58.814283 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-dbe86923-7d48-4fe0-8ba8-a4f413d6a197 req-8a29d295-e7eb-486b-993a-2029ff11274e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a54dc6f-8cee-4b66-9486-491841d01c27", "tag": "a8fa1465-9fa9-4b85-9370-89b6902a982d"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:58.828506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-dbe86923-7d48-4fe0-8ba8-a4f413d6a197 req-8a29d295-e7eb-486b-993a-2029ff11274e service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:58.832068 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-dbe86923-7d48-4fe0-8ba8-a4f413d6a197 req-8a29d295-e7eb-486b-993a-2029ff11274e service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:58.832068 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-dbe86923-7d48-4fe0-8ba8-a4f413d6a197 req-8a29d295-e7eb-486b-993a-2029ff11274e service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:58.852217 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-dbe86923-7d48-4fe0-8ba8-a4f413d6a197 req-8a29d295-e7eb-486b-993a-2029ff11274e service nova] Creating event network-changed:a8fa1465-9fa9-4b85-9370-89b6902a982d for instance 2a54dc6f-8cee-4b66-9486-491841d01c27 on hv-cinder-85391 Aug 30 05:12:58.858554 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-dbe86923-7d48-4fe0-8ba8-a4f413d6a197 req-8a29d295-e7eb-486b-993a-2029ff11274e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049185 Aug 30 05:12:58.860398 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 77/162] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:12:59.696220 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-addbe0d7-8537-4bb1-8ba7-77bedd5be46e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:59.696833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-addbe0d7-8537-4bb1-8ba7-77bedd5be46e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:59.709167 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-addbe0d7-8537-4bb1-8ba7-77bedd5be46e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:59.712487 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-addbe0d7-8537-4bb1-8ba7-77bedd5be46e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:59.712946 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-addbe0d7-8537-4bb1-8ba7-77bedd5be46e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:59.717810 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-addbe0d7-8537-4bb1-8ba7-77bedd5be46e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:59.718444 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-addbe0d7-8537-4bb1-8ba7-77bedd5be46e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:59.720467 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-addbe0d7-8537-4bb1-8ba7-77bedd5be46e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:00.057126 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-addbe0d7-8537-4bb1-8ba7-77bedd5be46e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:00.076575 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-addbe0d7-8537-4bb1-8ba7-77bedd5be46e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.384185 Aug 30 05:13:00.078545 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 86/163] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:59 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:00.609228 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-842afc53-3d2f-4118-ba67-f2d9d92d2632 req-f068ccb5-1e46-4bee-9dce-00740ea30fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f83c589-3a23-45aa-96c5-3cf9006b3830", "tag": "c5da19b6-98a0-4af9-b8f5-52291d4a9be0"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:00.635717 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-842afc53-3d2f-4118-ba67-f2d9d92d2632 req-f068ccb5-1e46-4bee-9dce-00740ea30fb4 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:00.635717 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-842afc53-3d2f-4118-ba67-f2d9d92d2632 req-f068ccb5-1e46-4bee-9dce-00740ea30fb4 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:00.635717 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-842afc53-3d2f-4118-ba67-f2d9d92d2632 req-f068ccb5-1e46-4bee-9dce-00740ea30fb4 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:00.654997 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-842afc53-3d2f-4118-ba67-f2d9d92d2632 req-f068ccb5-1e46-4bee-9dce-00740ea30fb4 service nova] Creating event network-changed:c5da19b6-98a0-4af9-b8f5-52291d4a9be0 for instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 on hv-cinder-85391 Aug 30 05:13:00.669137 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-842afc53-3d2f-4118-ba67-f2d9d92d2632 req-f068ccb5-1e46-4bee-9dce-00740ea30fb4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064446 Aug 30 05:13:00.672897 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 78/164] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:01.104817 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e1929971-8a4b-47bb-b779-ded415df4c58 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:01.106243 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e1929971-8a4b-47bb-b779-ded415df4c58 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:01.118361 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1929971-8a4b-47bb-b779-ded415df4c58 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:01.119173 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1929971-8a4b-47bb-b779-ded415df4c58 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:01.119943 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1929971-8a4b-47bb-b779-ded415df4c58 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:01.121038 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1929971-8a4b-47bb-b779-ded415df4c58 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:01.123507 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1929971-8a4b-47bb-b779-ded415df4c58 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:01.124638 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1929971-8a4b-47bb-b779-ded415df4c58 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:01.449118 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e1929971-8a4b-47bb-b779-ded415df4c58 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:01.474625 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e1929971-8a4b-47bb-b779-ded415df4c58 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.375561 Aug 30 05:13:01.475780 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 87/165] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:01 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:02.501511 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eaed2e64-a675-4f2e-aac3-2e5ec0dc131d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:02.502259 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eaed2e64-a675-4f2e-aac3-2e5ec0dc131d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:02.512052 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaed2e64-a675-4f2e-aac3-2e5ec0dc131d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:02.525987 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaed2e64-a675-4f2e-aac3-2e5ec0dc131d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:02.526493 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaed2e64-a675-4f2e-aac3-2e5ec0dc131d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:02.527286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaed2e64-a675-4f2e-aac3-2e5ec0dc131d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:02.527929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaed2e64-a675-4f2e-aac3-2e5ec0dc131d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:02.528543 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaed2e64-a675-4f2e-aac3-2e5ec0dc131d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:02.725555 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eaed2e64-a675-4f2e-aac3-2e5ec0dc131d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:02.738797 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eaed2e64-a675-4f2e-aac3-2e5ec0dc131d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.241729 Aug 30 05:13:02.739698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 79/166] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:02 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:03.763418 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-49f297db-f229-4c31-950f-280b0cca82d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:03.765627 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-49f297db-f229-4c31-950f-280b0cca82d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:03.775958 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-49f297db-f229-4c31-950f-280b0cca82d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:03.777029 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-49f297db-f229-4c31-950f-280b0cca82d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:03.777719 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-49f297db-f229-4c31-950f-280b0cca82d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:03.779182 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-49f297db-f229-4c31-950f-280b0cca82d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:03.780141 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-49f297db-f229-4c31-950f-280b0cca82d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:03.781455 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-49f297db-f229-4c31-950f-280b0cca82d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:04.018874 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-49f297db-f229-4c31-950f-280b0cca82d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:04.039398 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-49f297db-f229-4c31-950f-280b0cca82d9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.282160 Aug 30 05:13:04.039986 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 88/167] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:03 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:05.061165 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0c6b44d5-53e6-413d-8d3b-2f0955c46662 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:05.061769 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0c6b44d5-53e6-413d-8d3b-2f0955c46662 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:05.068411 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c6b44d5-53e6-413d-8d3b-2f0955c46662 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:05.068891 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c6b44d5-53e6-413d-8d3b-2f0955c46662 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:05.069324 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c6b44d5-53e6-413d-8d3b-2f0955c46662 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:05.070008 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c6b44d5-53e6-413d-8d3b-2f0955c46662 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:05.070612 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c6b44d5-53e6-413d-8d3b-2f0955c46662 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:05.072235 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c6b44d5-53e6-413d-8d3b-2f0955c46662 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:05.264874 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0c6b44d5-53e6-413d-8d3b-2f0955c46662 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:05.275624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0c6b44d5-53e6-413d-8d3b-2f0955c46662 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.218106 Aug 30 05:13:05.276618 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 80/168] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:05 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:06.304615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1b21b608-e293-4a37-9188-cec8142b4ed9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:06.305305 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1b21b608-e293-4a37-9188-cec8142b4ed9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:06.314252 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b21b608-e293-4a37-9188-cec8142b4ed9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:06.315471 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b21b608-e293-4a37-9188-cec8142b4ed9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:06.316146 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b21b608-e293-4a37-9188-cec8142b4ed9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:06.317029 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b21b608-e293-4a37-9188-cec8142b4ed9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:06.317630 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b21b608-e293-4a37-9188-cec8142b4ed9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:06.318227 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b21b608-e293-4a37-9188-cec8142b4ed9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:06.480553 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b6bc714d-8c75-47b5-b080-ef2552137423 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:06.481063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b6bc714d-8c75-47b5-b080-ef2552137423 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:06.488195 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6bc714d-8c75-47b5-b080-ef2552137423 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:06.488769 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6bc714d-8c75-47b5-b080-ef2552137423 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:06.489344 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6bc714d-8c75-47b5-b080-ef2552137423 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:06.490113 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6bc714d-8c75-47b5-b080-ef2552137423 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:06.490791 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6bc714d-8c75-47b5-b080-ef2552137423 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:06.491300 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6bc714d-8c75-47b5-b080-ef2552137423 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:06.523568 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b6bc714d-8c75-47b5-b080-ef2552137423 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:13:06.657017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b6bc714d-8c75-47b5-b080-ef2552137423 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 204 len: 0 microversion: 2.1 time: 0.180532 Aug 30 05:13:06.658070 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 81/169] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:13:06 2022] DELETE /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 05:13:06.667410 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8ca7c32c-896c-409a-9b89-92cbc3c8e483 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:06.668114 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8ca7c32c-896c-409a-9b89-92cbc3c8e483 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:06.676846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ca7c32c-896c-409a-9b89-92cbc3c8e483 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:06.677601 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ca7c32c-896c-409a-9b89-92cbc3c8e483 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:06.681370 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ca7c32c-896c-409a-9b89-92cbc3c8e483 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:06.681370 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ca7c32c-896c-409a-9b89-92cbc3c8e483 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:06.681370 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ca7c32c-896c-409a-9b89-92cbc3c8e483 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:06.681370 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8ca7c32c-896c-409a-9b89-92cbc3c8e483 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:06.710912 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1b21b608-e293-4a37-9188-cec8142b4ed9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:06.718919 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1b21b608-e293-4a37-9188-cec8142b4ed9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.422314 Aug 30 05:13:06.719758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 89/170] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:06 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:06.933431 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8ca7c32c-896c-409a-9b89-92cbc3c8e483 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:06.944669 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8ca7c32c-896c-409a-9b89-92cbc3c8e483 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1555 microversion: 2.1 time: 0.281450 Aug 30 05:13:06.945513 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 82/171] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:06 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1555 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:07.742692 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fbac6289-8d3f-448a-85ff-f6f21978f519 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:07.745246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fbac6289-8d3f-448a-85ff-f6f21978f519 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:07.754912 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbac6289-8d3f-448a-85ff-f6f21978f519 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:07.755632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbac6289-8d3f-448a-85ff-f6f21978f519 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:07.756253 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbac6289-8d3f-448a-85ff-f6f21978f519 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:07.757131 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbac6289-8d3f-448a-85ff-f6f21978f519 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:07.758048 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbac6289-8d3f-448a-85ff-f6f21978f519 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:07.758779 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fbac6289-8d3f-448a-85ff-f6f21978f519 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:07.784512 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:07.935648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fbac6289-8d3f-448a-85ff-f6f21978f519 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:07.944001 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fbac6289-8d3f-448a-85ff-f6f21978f519 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.208054 Aug 30 05:13:07.944634 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 90/172] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:07 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:07.967952 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-695e1aa6-f549-42ba-9ce5-d6de2314c1f3 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:07.968616 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-695e1aa6-f549-42ba-9ce5-d6de2314c1f3 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:07.981872 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-695e1aa6-f549-42ba-9ce5-d6de2314c1f3 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:07.982368 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-695e1aa6-f549-42ba-9ce5-d6de2314c1f3 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:07.982799 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-695e1aa6-f549-42ba-9ce5-d6de2314c1f3 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:07.991443 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-695e1aa6-f549-42ba-9ce5-d6de2314c1f3 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:07.991443 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-695e1aa6-f549-42ba-9ce5-d6de2314c1f3 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:07.991443 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-695e1aa6-f549-42ba-9ce5-d6de2314c1f3 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:08.193075 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-695e1aa6-f549-42ba-9ce5-d6de2314c1f3 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:08.207873 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-695e1aa6-f549-42ba-9ce5-d6de2314c1f3 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1555 microversion: 2.1 time: 0.243920 Aug 30 05:13:08.208477 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 83/173] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:07 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1555 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:08.965033 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f85226c1-78fd-43b9-b667-dcc0af34044b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:08.976190 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f85226c1-78fd-43b9-b667-dcc0af34044b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:08.983683 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f85226c1-78fd-43b9-b667-dcc0af34044b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:08.989299 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f85226c1-78fd-43b9-b667-dcc0af34044b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:08.995669 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f85226c1-78fd-43b9-b667-dcc0af34044b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:08.996428 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f85226c1-78fd-43b9-b667-dcc0af34044b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:08.996952 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f85226c1-78fd-43b9-b667-dcc0af34044b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:08.997616 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f85226c1-78fd-43b9-b667-dcc0af34044b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:09.181568 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f85226c1-78fd-43b9-b667-dcc0af34044b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:09.192801 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f85226c1-78fd-43b9-b667-dcc0af34044b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.230932 Aug 30 05:13:09.193520 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 91/174] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:08 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:09.229628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7112a1c3-90b5-429b-8693-202143401905 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:09.230867 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7112a1c3-90b5-429b-8693-202143401905 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:09.242328 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7112a1c3-90b5-429b-8693-202143401905 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:09.242846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7112a1c3-90b5-429b-8693-202143401905 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:09.243276 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7112a1c3-90b5-429b-8693-202143401905 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:09.243974 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7112a1c3-90b5-429b-8693-202143401905 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:09.244424 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7112a1c3-90b5-429b-8693-202143401905 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:09.244839 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7112a1c3-90b5-429b-8693-202143401905 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:09.477594 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7112a1c3-90b5-429b-8693-202143401905 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:09.486725 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7112a1c3-90b5-429b-8693-202143401905 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1555 microversion: 2.1 time: 0.261074 Aug 30 05:13:09.487334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 84/175] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:09 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1555 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:09.964911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-c0987607-5794-4791-a394-eda72f507b87 req-071d56e0-37ef-41a5-8be0-2b6b11204975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bae6994-d651-45c7-955b-13df805da49f", "name": "network-vif-deleted", "tag": "68faecf3-5b76-4ea3-b631-30ac4f8a4592"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:09.975029 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-c0987607-5794-4791-a394-eda72f507b87 req-071d56e0-37ef-41a5-8be0-2b6b11204975 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:09.975654 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-c0987607-5794-4791-a394-eda72f507b87 req-071d56e0-37ef-41a5-8be0-2b6b11204975 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:09.975854 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-c0987607-5794-4791-a394-eda72f507b87 req-071d56e0-37ef-41a5-8be0-2b6b11204975 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:09.989321 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-c0987607-5794-4791-a394-eda72f507b87 req-071d56e0-37ef-41a5-8be0-2b6b11204975 service nova] Creating event network-vif-deleted:68faecf3-5b76-4ea3-b631-30ac4f8a4592 for instance 2bae6994-d651-45c7-955b-13df805da49f on hv-cinder-85391 Aug 30 05:13:09.995104 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-c0987607-5794-4791-a394-eda72f507b87 req-071d56e0-37ef-41a5-8be0-2b6b11204975 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033649 Aug 30 05:13:09.995945 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 92/176] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:10.214002 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1a8cd025-0cf8-4d7b-ab8a-74677531b096 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:10.214767 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1a8cd025-0cf8-4d7b-ab8a-74677531b096 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:10.222007 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a8cd025-0cf8-4d7b-ab8a-74677531b096 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:10.222625 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a8cd025-0cf8-4d7b-ab8a-74677531b096 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:10.223252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a8cd025-0cf8-4d7b-ab8a-74677531b096 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:10.223963 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a8cd025-0cf8-4d7b-ab8a-74677531b096 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:10.224402 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a8cd025-0cf8-4d7b-ab8a-74677531b096 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:10.224822 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a8cd025-0cf8-4d7b-ab8a-74677531b096 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:10.375134 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1a8cd025-0cf8-4d7b-ab8a-74677531b096 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:10.383561 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1a8cd025-0cf8-4d7b-ab8a-74677531b096 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.173290 Aug 30 05:13:10.384144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 85/177] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:10 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:10.508118 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e7135f78-9ddf-40e6-8485-d29532ce2886 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:10.509033 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e7135f78-9ddf-40e6-8485-d29532ce2886 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:10.517831 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7135f78-9ddf-40e6-8485-d29532ce2886 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:10.518439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7135f78-9ddf-40e6-8485-d29532ce2886 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:10.518982 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7135f78-9ddf-40e6-8485-d29532ce2886 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:10.519753 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7135f78-9ddf-40e6-8485-d29532ce2886 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:10.520275 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7135f78-9ddf-40e6-8485-d29532ce2886 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:10.520779 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7135f78-9ddf-40e6-8485-d29532ce2886 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:10.556676 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7135f78-9ddf-40e6-8485-d29532ce2886 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:10.557166 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7135f78-9ddf-40e6-8485-d29532ce2886 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:10.560882 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-987556406", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452", "networks": [{"uuid": "e7f9908e-0aa3-4c4d-a73a-efe9fe4198e5"}]}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:10.563239 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e7135f78-9ddf-40e6-8485-d29532ce2886 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:10.564154 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-e7135f78-9ddf-40e6-8485-d29532ce2886 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lazy-loading 'fault' on Instance uuid 2bae6994-d651-45c7-955b-13df805da49f {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:13:10.613450 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e7135f78-9ddf-40e6-8485-d29532ce2886 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd611a49b03554b448a09fe86604af02b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed43db2f368485990e3add370edae5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:10.621586 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e7135f78-9ddf-40e6-8485-d29532ce2886 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 200 len: 1351 microversion: 2.1 time: 0.117839 Aug 30 05:13:10.622136 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 93/178] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:10 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 1351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:11.405583 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ab39ba0a-1455-4cc7-83aa-ad8e5b170134 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:11.406277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ab39ba0a-1455-4cc7-83aa-ad8e5b170134 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:11.412309 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab39ba0a-1455-4cc7-83aa-ad8e5b170134 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:11.412788 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab39ba0a-1455-4cc7-83aa-ad8e5b170134 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:11.413407 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab39ba0a-1455-4cc7-83aa-ad8e5b170134 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:11.414098 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab39ba0a-1455-4cc7-83aa-ad8e5b170134 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:11.414659 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab39ba0a-1455-4cc7-83aa-ad8e5b170134 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:11.415164 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab39ba0a-1455-4cc7-83aa-ad8e5b170134 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:11.570972 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ab39ba0a-1455-4cc7-83aa-ad8e5b170134 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:11.579684 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ab39ba0a-1455-4cc7-83aa-ad8e5b170134 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.177850 Aug 30 05:13:11.580283 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 94/179] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:11 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:11.641514 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d69b44cf-21ba-471a-bed1-28f34a2ab8e2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:11.642038 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d69b44cf-21ba-471a-bed1-28f34a2ab8e2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:11.648314 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d69b44cf-21ba-471a-bed1-28f34a2ab8e2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:11.648812 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d69b44cf-21ba-471a-bed1-28f34a2ab8e2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:11.649279 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d69b44cf-21ba-471a-bed1-28f34a2ab8e2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:11.649980 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d69b44cf-21ba-471a-bed1-28f34a2ab8e2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:11.650542 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d69b44cf-21ba-471a-bed1-28f34a2ab8e2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:11.651037 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d69b44cf-21ba-471a-bed1-28f34a2ab8e2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:11.665244 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-d69b44cf-21ba-471a-bed1-28f34a2ab8e2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] HTTP exception thrown: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d69b44cf-21ba-471a-bed1-28f34a2ab8e2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Request method failure captured: Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f HTTP/1.1 Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZwgLAVixLk1BVTe3QSB6bYBGCH_tH0EPRJdp5Idlfoh6V4hfFZphvInts9hJluXTxXlRXHjejdMsPaK0uVBf-u4B6yZxYlcxlFXHLiuj46Pj30kdrmk26JKXOVh4emAAR_ZXF0D1JV1s39iUObF6lF2cNBVWhEZWQSwV9gZUb1nnCI Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 0ed43db2f368485990e3add370edae5f Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-DeleteServersTestJSON-1377440117 Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:13:11.670188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:13:11.671666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0ed43db2f368485990e3add370edae5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/0ed43db2f368485990e3add370edae5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0ed43db2f368485990e3add370edae5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_0ed43db2f368485990e3add370edae5f", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:13:11.671666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-DeleteServersTestJSON-1377440117 Aug 30 05:13:11.671666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 0ed43db2f368485990e3add370edae5f Aug 30 05:13:11.671666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-DeleteServersTestJSON-1377440117 Aug 30 05:13:11.671666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-DeleteServersTestJSON-1377440117-project Aug 30 05:13:11.671666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:13:11.671666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:13:11.671666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: d611a49b03554b448a09fe86604af02b Aug 30 05:13:11.671666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-DeleteServersTestJSON-1377440117-project Aug 30 05:13:11.671666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:13:11.671666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:11.671666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '2bae6994-d651-45c7-955b-13df805da49f'} Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:13:11.672584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:11.674537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:11.675850 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d69b44cf-21ba-471a-bed1-28f34a2ab8e2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Returning 404 to user: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:13:11.675850 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d69b44cf-21ba-471a-bed1-28f34a2ab8e2 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 404 len: 111 microversion: 2.1 time: 0.034115 Aug 30 05:13:11.675850 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 95/180] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:11 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:13:11.783936 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-41e3bac3-26a5-47ae-a202-e5af6697d003 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:11.786192 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-41e3bac3-26a5-47ae-a202-e5af6697d003 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:11.792903 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41e3bac3-26a5-47ae-a202-e5af6697d003 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:11.793382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41e3bac3-26a5-47ae-a202-e5af6697d003 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:11.793818 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41e3bac3-26a5-47ae-a202-e5af6697d003 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:11.794506 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41e3bac3-26a5-47ae-a202-e5af6697d003 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:11.795084 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41e3bac3-26a5-47ae-a202-e5af6697d003 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:11.795560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-41e3bac3-26a5-47ae-a202-e5af6697d003 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:11.810242 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-41e3bac3-26a5-47ae-a202-e5af6697d003 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] HTTP exception thrown: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-41e3bac3-26a5-47ae-a202-e5af6697d003 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Request method failure captured: Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f/os-volume_attachments HTTP/1.1 Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZwgLAVixLk1BVTe3QSB6bYBGCH_tH0EPRJdp5Idlfoh6V4hfFZphvInts9hJluXTxXlRXHjejdMsPaK0uVBf-u4B6yZxYlcxlFXHLiuj46Pj30kdrmk26JKXOVh4emAAR_ZXF0D1JV1s39iUObF6lF2cNBVWhEZWQSwV9gZUb1nnCI Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 0ed43db2f368485990e3add370edae5f Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-DeleteServersTestJSON-1377440117 Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:13:11.812401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:13:11.813817 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0ed43db2f368485990e3add370edae5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/0ed43db2f368485990e3add370edae5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0ed43db2f368485990e3add370edae5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_0ed43db2f368485990e3add370edae5f", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:13:11.813817 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-DeleteServersTestJSON-1377440117 Aug 30 05:13:11.813817 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 0ed43db2f368485990e3add370edae5f Aug 30 05:13:11.813817 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-DeleteServersTestJSON-1377440117 Aug 30 05:13:11.813817 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-DeleteServersTestJSON-1377440117-project Aug 30 05:13:11.813817 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:13:11.813817 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:13:11.813817 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: d611a49b03554b448a09fe86604af02b Aug 30 05:13:11.813817 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-DeleteServersTestJSON-1377440117-project Aug 30 05:13:11.813817 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:13:11.813817 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:11.813817 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'server_id': '2bae6994-d651-45c7-955b-13df805da49f'} Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:13:11.814619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:11.815934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:11.817204 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-41e3bac3-26a5-47ae-a202-e5af6697d003 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Returning 404 to user: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:13:11.817204 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-41e3bac3-26a5-47ae-a202-e5af6697d003 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034334 Aug 30 05:13:11.817204 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 96/181] 10.222.0.77 () {58 vars in 1302 bytes} [Tue Aug 30 05:13:11 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:13:12.600852 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5fe63111-3d49-446a-8fe6-bd3ba3554a8d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:12.601461 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5fe63111-3d49-446a-8fe6-bd3ba3554a8d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:12.608878 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5fe63111-3d49-446a-8fe6-bd3ba3554a8d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:12.609376 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5fe63111-3d49-446a-8fe6-bd3ba3554a8d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:12.609806 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5fe63111-3d49-446a-8fe6-bd3ba3554a8d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:12.610507 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5fe63111-3d49-446a-8fe6-bd3ba3554a8d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:12.610988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5fe63111-3d49-446a-8fe6-bd3ba3554a8d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:12.611407 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5fe63111-3d49-446a-8fe6-bd3ba3554a8d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:12.742650 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5fe63111-3d49-446a-8fe6-bd3ba3554a8d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:12.750363 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5fe63111-3d49-446a-8fe6-bd3ba3554a8d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.154035 Aug 30 05:13:12.750937 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 97/182] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:12 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:13.013841 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-920edfd8-5da1-4029-babf-78995c9dbd3b tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:13.014532 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-920edfd8-5da1-4029-babf-78995c9dbd3b tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:13.021027 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920edfd8-5da1-4029-babf-78995c9dbd3b tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:13.021481 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920edfd8-5da1-4029-babf-78995c9dbd3b tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:13.021900 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920edfd8-5da1-4029-babf-78995c9dbd3b tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:13.022598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920edfd8-5da1-4029-babf-78995c9dbd3b tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:13.023075 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920edfd8-5da1-4029-babf-78995c9dbd3b tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:13.023498 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-920edfd8-5da1-4029-babf-78995c9dbd3b tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:13.036628 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-920edfd8-5da1-4029-babf-78995c9dbd3b tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] HTTP exception thrown: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-920edfd8-5da1-4029-babf-78995c9dbd3b tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Request method failure captured: Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f HTTP/1.1 Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZwgLAVixLk1BVTe3QSB6bYBGCH_tH0EPRJdp5Idlfoh6V4hfFZphvInts9hJluXTxXlRXHjejdMsPaK0uVBf-u4B6yZxYlcxlFXHLiuj46Pj30kdrmk26JKXOVh4emAAR_ZXF0D1JV1s39iUObF6lF2cNBVWhEZWQSwV9gZUb1nnCI Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 0ed43db2f368485990e3add370edae5f Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-DeleteServersTestJSON-1377440117 Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:13:13.038144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:13:13.039588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0ed43db2f368485990e3add370edae5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/0ed43db2f368485990e3add370edae5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0ed43db2f368485990e3add370edae5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_0ed43db2f368485990e3add370edae5f", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:13:13.039588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-DeleteServersTestJSON-1377440117 Aug 30 05:13:13.039588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 0ed43db2f368485990e3add370edae5f Aug 30 05:13:13.039588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-DeleteServersTestJSON-1377440117 Aug 30 05:13:13.039588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-DeleteServersTestJSON-1377440117-project Aug 30 05:13:13.039588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:13:13.039588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:13:13.039588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: d611a49b03554b448a09fe86604af02b Aug 30 05:13:13.039588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-DeleteServersTestJSON-1377440117-project Aug 30 05:13:13.039588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:13:13.039588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:13.039588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '2bae6994-d651-45c7-955b-13df805da49f'} Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:13:13.040369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:13.041663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:13.043009 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-920edfd8-5da1-4029-babf-78995c9dbd3b tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Returning 404 to user: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:13:13.043009 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-920edfd8-5da1-4029-babf-78995c9dbd3b tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 404 len: 111 microversion: 2.1 time: 0.029896 Aug 30 05:13:13.043009 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 98/183] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:13:13 2022] DELETE /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:13:13.047559 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-23984642-1ff8-481a-805a-a828f7688f63 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:13.048160 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-23984642-1ff8-481a-805a-a828f7688f63 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] [instance: 2bae6994-d651-45c7-955b-13df805da49f] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:13.054696 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23984642-1ff8-481a-805a-a828f7688f63 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:13.055256 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23984642-1ff8-481a-805a-a828f7688f63 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:13.055717 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23984642-1ff8-481a-805a-a828f7688f63 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:13.056405 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23984642-1ff8-481a-805a-a828f7688f63 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:13.056857 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23984642-1ff8-481a-805a-a828f7688f63 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:13.057458 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-23984642-1ff8-481a-805a-a828f7688f63 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:13.072479 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-23984642-1ff8-481a-805a-a828f7688f63 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] HTTP exception thrown: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-23984642-1ff8-481a-805a-a828f7688f63 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Request method failure captured: Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f HTTP/1.1 Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZwgLAVixLk1BVTe3QSB6bYBGCH_tH0EPRJdp5Idlfoh6V4hfFZphvInts9hJluXTxXlRXHjejdMsPaK0uVBf-u4B6yZxYlcxlFXHLiuj46Pj30kdrmk26JKXOVh4emAAR_ZXF0D1JV1s39iUObF6lF2cNBVWhEZWQSwV9gZUb1nnCI Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 0ed43db2f368485990e3add370edae5f Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-DeleteServersTestJSON-1377440117 Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:13:13.074295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:13:13.075823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0ed43db2f368485990e3add370edae5f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/0ed43db2f368485990e3add370edae5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0ed43db2f368485990e3add370edae5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_0ed43db2f368485990e3add370edae5f", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:13:13.075823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-DeleteServersTestJSON-1377440117 Aug 30 05:13:13.075823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 0ed43db2f368485990e3add370edae5f Aug 30 05:13:13.075823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-DeleteServersTestJSON-1377440117 Aug 30 05:13:13.075823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-DeleteServersTestJSON-1377440117-project Aug 30 05:13:13.075823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:13:13.075823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:13:13.075823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: d611a49b03554b448a09fe86604af02b Aug 30 05:13:13.075823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-DeleteServersTestJSON-1377440117-project Aug 30 05:13:13.075823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:13:13.075823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:13.075823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '2bae6994-d651-45c7-955b-13df805da49f'} Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:13:13.076661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. Aug 30 05:13:13.077957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:13.079305 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-23984642-1ff8-481a-805a-a828f7688f63 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] Returning 404 to user: Instance 2bae6994-d651-45c7-955b-13df805da49f could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:13:13.079305 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-23984642-1ff8-481a-805a-a828f7688f63 tempest-DeleteServersTestJSON-1377440117 tempest-DeleteServersTestJSON-1377440117-project] 10.222.0.77 "GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f" status: 404 len: 111 microversion: 2.1 time: 0.033477 Aug 30 05:13:13.080064 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 99/184] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:13 2022] GET /compute/v2.1/servers/2bae6994-d651-45c7-955b-13df805da49f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:13:13.771965 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-530a2655-0227-4803-9734-df9f114874f7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:13.772565 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-530a2655-0227-4803-9734-df9f114874f7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:13.778841 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-530a2655-0227-4803-9734-df9f114874f7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:13.779359 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-530a2655-0227-4803-9734-df9f114874f7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:13.779773 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-530a2655-0227-4803-9734-df9f114874f7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:13.780531 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-530a2655-0227-4803-9734-df9f114874f7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:13.780987 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-530a2655-0227-4803-9734-df9f114874f7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:13.781411 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-530a2655-0227-4803-9734-df9f114874f7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:13.916002 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-530a2655-0227-4803-9734-df9f114874f7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:13.924486 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-530a2655-0227-4803-9734-df9f114874f7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.156965 Aug 30 05:13:13.925063 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 100/185] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:13 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:14.955011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-32e8aec7-839b-4aea-9fa5-096cf9cc818f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:14.956853 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-32e8aec7-839b-4aea-9fa5-096cf9cc818f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:14.964670 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32e8aec7-839b-4aea-9fa5-096cf9cc818f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:14.965405 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32e8aec7-839b-4aea-9fa5-096cf9cc818f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:14.966084 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32e8aec7-839b-4aea-9fa5-096cf9cc818f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:14.967078 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32e8aec7-839b-4aea-9fa5-096cf9cc818f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:14.967695 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32e8aec7-839b-4aea-9fa5-096cf9cc818f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:14.968269 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-32e8aec7-839b-4aea-9fa5-096cf9cc818f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:15.201573 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-32e8aec7-839b-4aea-9fa5-096cf9cc818f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:15.210585 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-32e8aec7-839b-4aea-9fa5-096cf9cc818f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.262981 Aug 30 05:13:15.212159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 101/186] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:14 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:15.476724 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] validate_networks() for [('e7f9908e-0aa3-4c4d-a73a-efe9fe4198e5', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:13:16.210296 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:13:16.210731 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:13:16.211328 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:13:16.211736 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:13:16.212171 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:13:16.223838 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:16.224393 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:16.224829 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:16.226066 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:16.226566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:16.227228 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:16.244621 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-610a123d-e868-4d06-b795-acd1720dab08 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:16.246267 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-610a123d-e868-4d06-b795-acd1720dab08 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:16.251617 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Getting quotas for project 9cea756f95e843b5868e53f6446d648a. Resources: {'instances', 'ram', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:13:16.256993 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-610a123d-e868-4d06-b795-acd1720dab08 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:16.257276 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Getting quotas for user b50d70f00f33494e81d4aac49df96dc4 and project 9cea756f95e843b5868e53f6446d648a. Resources: {'instances', 'ram', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:13:16.258409 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-610a123d-e868-4d06-b795-acd1720dab08 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:16.258890 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-610a123d-e868-4d06-b795-acd1720dab08 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:16.259592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-610a123d-e868-4d06-b795-acd1720dab08 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:16.260591 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-610a123d-e868-4d06-b795-acd1720dab08 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:16.261025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-610a123d-e868-4d06-b795-acd1720dab08 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:16.271353 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:13:16.274155 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:13:16.354685 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bcb2697f-211c-4d3c-9c9e-9997a092cdf3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.802477 Aug 30 05:13:16.356172 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 86/187] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:13:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 5805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:13:16.371104 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e9d5b667-ae4a-4316-bff8-26c2e79a6aa7 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:16.372136 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e9d5b667-ae4a-4316-bff8-26c2e79a6aa7 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:16.446390 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e9d5b667-ae4a-4316-bff8-26c2e79a6aa7 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:16.453516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e9d5b667-ae4a-4316-bff8-26c2e79a6aa7 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 200 len: 1213 microversion: 2.1 time: 0.089549 Aug 30 05:13:16.454103 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 87/188] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:16 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:16.713602 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-610a123d-e868-4d06-b795-acd1720dab08 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:16.724589 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-610a123d-e868-4d06-b795-acd1720dab08 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.490831 Aug 30 05:13:16.725172 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 102/189] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:16 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:17.478940 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-403ab956-b26c-4add-9c4e-c8a39ddba9d3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:17.479562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-403ab956-b26c-4add-9c4e-c8a39ddba9d3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:17.487608 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-403ab956-b26c-4add-9c4e-c8a39ddba9d3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:17.488661 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-403ab956-b26c-4add-9c4e-c8a39ddba9d3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:17.489421 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-403ab956-b26c-4add-9c4e-c8a39ddba9d3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:17.490312 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-403ab956-b26c-4add-9c4e-c8a39ddba9d3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:17.490986 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-403ab956-b26c-4add-9c4e-c8a39ddba9d3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:17.491566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-403ab956-b26c-4add-9c4e-c8a39ddba9d3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:17.567281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-403ab956-b26c-4add-9c4e-c8a39ddba9d3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:17.576240 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-403ab956-b26c-4add-9c4e-c8a39ddba9d3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 200 len: 1265 microversion: 2.1 time: 0.102397 Aug 30 05:13:17.576813 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 88/190] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:17 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:17.748195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cc21a894-cc9a-4bff-915f-c7d854a97996 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:17.748713 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cc21a894-cc9a-4bff-915f-c7d854a97996 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:17.760511 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc21a894-cc9a-4bff-915f-c7d854a97996 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:17.761673 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc21a894-cc9a-4bff-915f-c7d854a97996 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:17.763219 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc21a894-cc9a-4bff-915f-c7d854a97996 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:17.763949 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc21a894-cc9a-4bff-915f-c7d854a97996 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:17.764459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc21a894-cc9a-4bff-915f-c7d854a97996 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:17.764820 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc21a894-cc9a-4bff-915f-c7d854a97996 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:17.935842 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cc21a894-cc9a-4bff-915f-c7d854a97996 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:17.944322 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cc21a894-cc9a-4bff-915f-c7d854a97996 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.199989 Aug 30 05:13:17.945454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 103/191] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:17 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:18.598511 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ec009026-c05e-4aa8-ad00-81aca896559c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:18.601029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ec009026-c05e-4aa8-ad00-81aca896559c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:18.613628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec009026-c05e-4aa8-ad00-81aca896559c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:18.614357 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec009026-c05e-4aa8-ad00-81aca896559c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:18.617402 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec009026-c05e-4aa8-ad00-81aca896559c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:18.618268 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec009026-c05e-4aa8-ad00-81aca896559c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:18.618884 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec009026-c05e-4aa8-ad00-81aca896559c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:18.619539 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec009026-c05e-4aa8-ad00-81aca896559c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:18.701976 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ec009026-c05e-4aa8-ad00-81aca896559c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:18.712739 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ec009026-c05e-4aa8-ad00-81aca896559c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 200 len: 1271 microversion: 2.1 time: 0.119359 Aug 30 05:13:18.713610 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 89/192] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:18 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:18.967191 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-93fd284b-b3c6-4b81-9952-931095bdad42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:18.968413 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-93fd284b-b3c6-4b81-9952-931095bdad42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:18.978908 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93fd284b-b3c6-4b81-9952-931095bdad42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:18.979665 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93fd284b-b3c6-4b81-9952-931095bdad42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:18.980248 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93fd284b-b3c6-4b81-9952-931095bdad42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:18.981102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93fd284b-b3c6-4b81-9952-931095bdad42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:18.982517 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93fd284b-b3c6-4b81-9952-931095bdad42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:18.984885 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93fd284b-b3c6-4b81-9952-931095bdad42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:19.168561 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-93fd284b-b3c6-4b81-9952-931095bdad42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:19.183025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-93fd284b-b3c6-4b81-9952-931095bdad42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.220817 Aug 30 05:13:19.183602 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 104/193] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:18 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:19.573806 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-1133cea5-40f2-4a37-a3a9-64eaa8b7c700 req-55da7fdd-2d89-4799-adf6-a2198f52d90f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "209cce85-549b-4cdd-8228-f9d3b40dd030", "tag": "9529616f-ee1b-4e04-bee9-facc87ae87f6"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:19.584543 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-1133cea5-40f2-4a37-a3a9-64eaa8b7c700 req-55da7fdd-2d89-4799-adf6-a2198f52d90f service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:19.585098 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-1133cea5-40f2-4a37-a3a9-64eaa8b7c700 req-55da7fdd-2d89-4799-adf6-a2198f52d90f service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:19.585435 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-1133cea5-40f2-4a37-a3a9-64eaa8b7c700 req-55da7fdd-2d89-4799-adf6-a2198f52d90f service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:19.597359 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-1133cea5-40f2-4a37-a3a9-64eaa8b7c700 req-55da7fdd-2d89-4799-adf6-a2198f52d90f service nova] Creating event network-changed:9529616f-ee1b-4e04-bee9-facc87ae87f6 for instance 209cce85-549b-4cdd-8228-f9d3b40dd030 on hv-cinder-85391 Aug 30 05:13:19.602751 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-1133cea5-40f2-4a37-a3a9-64eaa8b7c700 req-55da7fdd-2d89-4799-adf6-a2198f52d90f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032309 Aug 30 05:13:19.604189 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 90/194] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:19.734470 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4c8ea537-5db7-461a-a214-c2cef268bfac tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:19.735107 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4c8ea537-5db7-461a-a214-c2cef268bfac tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:19.741266 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c8ea537-5db7-461a-a214-c2cef268bfac tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:19.741757 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c8ea537-5db7-461a-a214-c2cef268bfac tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:19.742186 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c8ea537-5db7-461a-a214-c2cef268bfac tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:19.743137 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c8ea537-5db7-461a-a214-c2cef268bfac tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:19.743901 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c8ea537-5db7-461a-a214-c2cef268bfac tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:19.744753 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c8ea537-5db7-461a-a214-c2cef268bfac tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:19.905691 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4c8ea537-5db7-461a-a214-c2cef268bfac tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:19.915733 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4c8ea537-5db7-461a-a214-c2cef268bfac tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 200 len: 1313 microversion: 2.1 time: 0.184990 Aug 30 05:13:19.916845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 105/195] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:19 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:20.205066 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-25f05f07-c3bc-4a88-bbbb-2cfd4cfa1ab8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:20.206410 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-25f05f07-c3bc-4a88-bbbb-2cfd4cfa1ab8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:20.212374 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25f05f07-c3bc-4a88-bbbb-2cfd4cfa1ab8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:20.212850 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25f05f07-c3bc-4a88-bbbb-2cfd4cfa1ab8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:20.213279 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25f05f07-c3bc-4a88-bbbb-2cfd4cfa1ab8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:20.213956 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25f05f07-c3bc-4a88-bbbb-2cfd4cfa1ab8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:20.214405 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25f05f07-c3bc-4a88-bbbb-2cfd4cfa1ab8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:20.214840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-25f05f07-c3bc-4a88-bbbb-2cfd4cfa1ab8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:20.340356 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-25f05f07-c3bc-4a88-bbbb-2cfd4cfa1ab8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:20.348946 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-25f05f07-c3bc-4a88-bbbb-2cfd4cfa1ab8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.148530 Aug 30 05:13:20.349519 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 91/196] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:20 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:20.532389 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7893272e-b3d5-406c-abc0-c07c30fd5e59 tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] Calling method '.version_select at 0x7f82305881f0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:20.600340 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7893272e-b3d5-406c-abc0-c07c30fd5e59 tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/ac039d94-f046-42c6-91db-d358e5370d09" status: 200 len: 350 microversion: 2.1 time: 0.071700 Aug 30 05:13:20.600908 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 106/197] 10.222.0.77 () {58 vars in 1245 bytes} [Tue Aug 30 05:13:20 2022] GET /compute/v2.1/os-volumes/ac039d94-f046-42c6-91db-d358e5370d09 => generated 350 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:20.935694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fa41f423-41a2-476c-baf5-e638b743b59b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:20.936335 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fa41f423-41a2-476c-baf5-e638b743b59b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:20.942973 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa41f423-41a2-476c-baf5-e638b743b59b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:20.943454 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa41f423-41a2-476c-baf5-e638b743b59b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:20.943915 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa41f423-41a2-476c-baf5-e638b743b59b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:20.944602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa41f423-41a2-476c-baf5-e638b743b59b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:20.945078 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa41f423-41a2-476c-baf5-e638b743b59b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:20.945498 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa41f423-41a2-476c-baf5-e638b743b59b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:21.084205 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fa41f423-41a2-476c-baf5-e638b743b59b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:21.091677 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fa41f423-41a2-476c-baf5-e638b743b59b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 200 len: 1313 microversion: 2.1 time: 0.159851 Aug 30 05:13:21.092238 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 92/198] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:20 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:21.369631 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-333150a1-d543-4b02-a6a6-75beec88223d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:21.370263 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-333150a1-d543-4b02-a6a6-75beec88223d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:21.377263 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-333150a1-d543-4b02-a6a6-75beec88223d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:21.378248 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-333150a1-d543-4b02-a6a6-75beec88223d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:21.378704 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-333150a1-d543-4b02-a6a6-75beec88223d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:21.379509 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-333150a1-d543-4b02-a6a6-75beec88223d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:21.379966 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-333150a1-d543-4b02-a6a6-75beec88223d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:21.380389 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-333150a1-d543-4b02-a6a6-75beec88223d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:21.514831 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-333150a1-d543-4b02-a6a6-75beec88223d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:21.523871 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-333150a1-d543-4b02-a6a6-75beec88223d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.158506 Aug 30 05:13:21.524456 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 107/199] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:21 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:21.957741 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cfab4eaa-c644-4446-85b3-16c7a43303c1 tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] Calling method '.version_select at 0x7f822f022a60>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:22.012930 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cfab4eaa-c644-4446-85b3-16c7a43303c1 tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/8a659edd-7c22-4c2a-bb44-022066552f20" status: 200 len: 350 microversion: 2.1 time: 0.059395 Aug 30 05:13:22.013949 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 93/200] 10.222.0.77 () {58 vars in 1245 bytes} [Tue Aug 30 05:13:21 2022] GET /compute/v2.1/os-volumes/8a659edd-7c22-4c2a-bb44-022066552f20 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:22.114097 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fe1a7404-cc8f-4e9b-ac43-a24729642db0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:22.114712 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fe1a7404-cc8f-4e9b-ac43-a24729642db0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:22.121022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe1a7404-cc8f-4e9b-ac43-a24729642db0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:22.122129 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe1a7404-cc8f-4e9b-ac43-a24729642db0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:22.122955 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe1a7404-cc8f-4e9b-ac43-a24729642db0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:22.123902 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe1a7404-cc8f-4e9b-ac43-a24729642db0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:22.124561 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe1a7404-cc8f-4e9b-ac43-a24729642db0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:22.125271 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fe1a7404-cc8f-4e9b-ac43-a24729642db0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:22.295759 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fe1a7404-cc8f-4e9b-ac43-a24729642db0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:22.304280 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fe1a7404-cc8f-4e9b-ac43-a24729642db0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 200 len: 1313 microversion: 2.1 time: 0.195561 Aug 30 05:13:22.304840 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 108/201] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:22 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:22.545165 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-555139da-d322-4e88-8d48-303b4e46d7bd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:22.545773 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-555139da-d322-4e88-8d48-303b4e46d7bd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:22.563108 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:22.564525 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555139da-d322-4e88-8d48-303b4e46d7bd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:22.565042 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555139da-d322-4e88-8d48-303b4e46d7bd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:22.565473 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555139da-d322-4e88-8d48-303b4e46d7bd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:22.566171 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555139da-d322-4e88-8d48-303b4e46d7bd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:22.566623 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555139da-d322-4e88-8d48-303b4e46d7bd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:22.581624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-555139da-d322-4e88-8d48-303b4e46d7bd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:22.586405 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:22.738997 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-555139da-d322-4e88-8d48-303b4e46d7bd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:22.746639 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-555139da-d322-4e88-8d48-303b4e46d7bd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.205250 Aug 30 05:13:22.747231 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 94/202] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:22 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:23.326615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fa76d734-cded-4c10-a8d4-4d4c0816c905 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:23.327393 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fa76d734-cded-4c10-a8d4-4d4c0816c905 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:23.335175 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa76d734-cded-4c10-a8d4-4d4c0816c905 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:23.335862 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa76d734-cded-4c10-a8d4-4d4c0816c905 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:23.336398 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa76d734-cded-4c10-a8d4-4d4c0816c905 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:23.337000 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa76d734-cded-4c10-a8d4-4d4c0816c905 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:23.337539 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa76d734-cded-4c10-a8d4-4d4c0816c905 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:23.337966 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fa76d734-cded-4c10-a8d4-4d4c0816c905 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:23.461375 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7949c0c4-3dc2-4100-a41f-026ed1f9a419 tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] Calling method '.version_select at 0x7f822f0c1f70>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:23.488504 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fa76d734-cded-4c10-a8d4-4d4c0816c905 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:23.497168 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fa76d734-cded-4c10-a8d4-4d4c0816c905 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 200 len: 1313 microversion: 2.1 time: 0.175540 Aug 30 05:13:23.498907 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 109/203] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:23 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:23.522963 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7949c0c4-3dc2-4100-a41f-026ed1f9a419 tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/c5b3196f-380b-4bdd-832f-9866dd59204f" status: 200 len: 351 microversion: 2.1 time: 0.065402 Aug 30 05:13:23.524084 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 95/204] 10.222.0.77 () {58 vars in 1245 bytes} [Tue Aug 30 05:13:23 2022] GET /compute/v2.1/os-volumes/c5b3196f-380b-4bdd-832f-9866dd59204f => generated 351 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:13:23.536907 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b676239-076e-4162-9983-46a985f5b864 tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] Calling method '.version_select at 0x7f822ef2e160>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:23.618241 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8b676239-076e-4162-9983-46a985f5b864 tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.085595 Aug 30 05:13:23.618863 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 110/205] 10.222.0.77 () {58 vars in 1134 bytes} [Tue Aug 30 05:13:23 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:23.631948 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d6d88bb6-9250-4cda-8a4e-9d4a8ce559c0 tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] Calling method '.version_select at 0x7f822f012820>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:23.735850 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d6d88bb6-9250-4cda-8a4e-9d4a8ce559c0 tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.107603 Aug 30 05:13:23.736557 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 96/206] 10.222.0.77 () {58 vars in 1149 bytes} [Tue Aug 30 05:13:23 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:23.751755 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-370d4cc3-1c01-4dde-a74c-0f63a871fa2d tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] Calling method '.version_select at 0x7f822ef954c0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:23.769271 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e3268c76-f2ff-4141-8d75-31c8ed30d3b5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:23.770241 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e3268c76-f2ff-4141-8d75-31c8ed30d3b5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:23.781074 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3268c76-f2ff-4141-8d75-31c8ed30d3b5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:23.781832 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3268c76-f2ff-4141-8d75-31c8ed30d3b5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:23.782563 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3268c76-f2ff-4141-8d75-31c8ed30d3b5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:23.783530 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3268c76-f2ff-4141-8d75-31c8ed30d3b5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:23.784235 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3268c76-f2ff-4141-8d75-31c8ed30d3b5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:23.784928 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e3268c76-f2ff-4141-8d75-31c8ed30d3b5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:23.856609 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-370d4cc3-1c01-4dde-a74c-0f63a871fa2d tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.109769 Aug 30 05:13:23.857329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 111/207] 10.222.0.77 () {58 vars in 1134 bytes} [Tue Aug 30 05:13:23 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:23.869959 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c2848ca7-4933-4bee-8670-0c3a69a793b4 tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] Calling method '.version_select at 0x7f822ef22ee0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:23.936409 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e3268c76-f2ff-4141-8d75-31c8ed30d3b5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:23.944622 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e3268c76-f2ff-4141-8d75-31c8ed30d3b5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.180905 Aug 30 05:13:23.945192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 97/208] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:23 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:23.957274 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c2848ca7-4933-4bee-8670-0c3a69a793b4 tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091145 Aug 30 05:13:23.957845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 112/209] 10.222.0.77 () {58 vars in 1167 bytes} [Tue Aug 30 05:13:23 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:13:23.970934 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f7928cd1-ccbf-496e-8008-e0fa29a5c440 tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] Calling method '.version_select at 0x7f822f012160>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:24.054741 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f7928cd1-ccbf-496e-8008-e0fa29a5c440 tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087551 Aug 30 05:13:24.055413 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 98/210] 10.222.0.77 () {58 vars in 1170 bytes} [Tue Aug 30 05:13:23 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:24.074613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8ba407f9-e0dd-43f5-a65c-1117e296c8df tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] Calling method '.version_select at 0x7f822ef22040>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:24.160601 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8ba407f9-e0dd-43f5-a65c-1117e296c8df tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089611 Aug 30 05:13:24.161182 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 113/211] 10.222.0.77 () {58 vars in 1155 bytes} [Tue Aug 30 05:13:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:24.175163 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e582da8a-69c5-43db-92a0-53bf502909df tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] Calling method '.version_select at 0x7f822f022040>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:24.258516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e582da8a-69c5-43db-92a0-53bf502909df tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087620 Aug 30 05:13:24.259125 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 99/212] 10.222.0.77 () {58 vars in 1188 bytes} [Tue Aug 30 05:13:24 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:24.272435 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-76a06d6b-c1d4-46b8-b4f1-a3222e863a94 tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] Calling method '.version_select at 0x7f822ef95e50>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:24.354944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-76a06d6b-c1d4-46b8-b4f1-a3222e863a94 tempest-VolumesTestJSON-250559150 tempest-VolumesTestJSON-250559150-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.086227 Aug 30 05:13:24.355526 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 114/213] 10.222.0.77 () {58 vars in 1155 bytes} [Tue Aug 30 05:13:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:24.520019 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-427044af-39cb-4c8b-9382-b1b1035a971a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:24.520567 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-427044af-39cb-4c8b-9382-b1b1035a971a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:24.526410 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-427044af-39cb-4c8b-9382-b1b1035a971a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:24.526935 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-427044af-39cb-4c8b-9382-b1b1035a971a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:24.527377 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-427044af-39cb-4c8b-9382-b1b1035a971a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:24.528069 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-427044af-39cb-4c8b-9382-b1b1035a971a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:24.528529 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-427044af-39cb-4c8b-9382-b1b1035a971a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:24.528956 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-427044af-39cb-4c8b-9382-b1b1035a971a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:24.667266 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-427044af-39cb-4c8b-9382-b1b1035a971a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:24.675573 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-427044af-39cb-4c8b-9382-b1b1035a971a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 200 len: 1313 microversion: 2.1 time: 0.161030 Aug 30 05:13:24.676150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 100/214] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:24 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:24.965508 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-06e63c0d-48aa-4d02-b3e5-c7a7f82f768b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:24.966149 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-06e63c0d-48aa-4d02-b3e5-c7a7f82f768b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:24.969138 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=69 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:24.977499 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e63c0d-48aa-4d02-b3e5-c7a7f82f768b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:24.978494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e63c0d-48aa-4d02-b3e5-c7a7f82f768b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:24.979085 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e63c0d-48aa-4d02-b3e5-c7a7f82f768b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:24.980316 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e63c0d-48aa-4d02-b3e5-c7a7f82f768b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:24.980646 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e63c0d-48aa-4d02-b3e5-c7a7f82f768b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:24.981329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e63c0d-48aa-4d02-b3e5-c7a7f82f768b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:25.126771 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-06e63c0d-48aa-4d02-b3e5-c7a7f82f768b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:25.135300 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-06e63c0d-48aa-4d02-b3e5-c7a7f82f768b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.173620 Aug 30 05:13:25.136225 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 115/215] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:24 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:25.346292 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-278747e3-fc1e-4856-b4db-5599bd8c262a req-42fad4f6-2b19-40c3-9794-a3856e14c5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "209cce85-549b-4cdd-8228-f9d3b40dd030", "name": "network-vif-plugged", "status": "completed", "tag": "9529616f-ee1b-4e04-bee9-facc87ae87f6"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:25.362207 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-278747e3-fc1e-4856-b4db-5599bd8c262a req-42fad4f6-2b19-40c3-9794-a3856e14c5b4 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:25.368105 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-278747e3-fc1e-4856-b4db-5599bd8c262a req-42fad4f6-2b19-40c3-9794-a3856e14c5b4 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:25.368777 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-278747e3-fc1e-4856-b4db-5599bd8c262a req-42fad4f6-2b19-40c3-9794-a3856e14c5b4 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:25.381624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-278747e3-fc1e-4856-b4db-5599bd8c262a req-42fad4f6-2b19-40c3-9794-a3856e14c5b4 service nova] Creating event network-vif-plugged:9529616f-ee1b-4e04-bee9-facc87ae87f6 for instance 209cce85-549b-4cdd-8228-f9d3b40dd030 on hv-cinder-85391 Aug 30 05:13:25.386669 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-278747e3-fc1e-4856-b4db-5599bd8c262a req-42fad4f6-2b19-40c3-9794-a3856e14c5b4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044419 Aug 30 05:13:25.387290 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 101/216] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:25.696916 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-666555c4-9a9b-467d-aab6-0efd4a01e51b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:25.697557 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-666555c4-9a9b-467d-aab6-0efd4a01e51b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:25.703996 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-666555c4-9a9b-467d-aab6-0efd4a01e51b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:25.704486 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-666555c4-9a9b-467d-aab6-0efd4a01e51b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:25.704920 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-666555c4-9a9b-467d-aab6-0efd4a01e51b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:25.706219 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-666555c4-9a9b-467d-aab6-0efd4a01e51b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:25.706687 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-666555c4-9a9b-467d-aab6-0efd4a01e51b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:25.707130 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-666555c4-9a9b-467d-aab6-0efd4a01e51b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:25.711500 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:25.907011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-666555c4-9a9b-467d-aab6-0efd4a01e51b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:25.917975 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-666555c4-9a9b-467d-aab6-0efd4a01e51b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 200 len: 1313 microversion: 2.1 time: 0.224910 Aug 30 05:13:25.918998 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 116/217] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:25 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:26.172463 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c85dec84-643d-4fbf-83f1-d7a01881cfc4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:26.173173 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c85dec84-643d-4fbf-83f1-d7a01881cfc4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:26.180323 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c85dec84-643d-4fbf-83f1-d7a01881cfc4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:26.181083 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c85dec84-643d-4fbf-83f1-d7a01881cfc4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:26.181561 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c85dec84-643d-4fbf-83f1-d7a01881cfc4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:26.182425 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c85dec84-643d-4fbf-83f1-d7a01881cfc4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:26.183139 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c85dec84-643d-4fbf-83f1-d7a01881cfc4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:26.183560 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c85dec84-643d-4fbf-83f1-d7a01881cfc4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:26.239380 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:26.320280 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c85dec84-643d-4fbf-83f1-d7a01881cfc4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:26.327923 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c85dec84-643d-4fbf-83f1-d7a01881cfc4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.173679 Aug 30 05:13:26.328509 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 102/218] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:26 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:26.938674 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7ad0e58b-ae56-4038-80fd-c86c620f8089 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:26.939398 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7ad0e58b-ae56-4038-80fd-c86c620f8089 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:26.945988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad0e58b-ae56-4038-80fd-c86c620f8089 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:26.946472 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad0e58b-ae56-4038-80fd-c86c620f8089 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:26.946935 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad0e58b-ae56-4038-80fd-c86c620f8089 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:26.947625 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad0e58b-ae56-4038-80fd-c86c620f8089 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:26.948077 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad0e58b-ae56-4038-80fd-c86c620f8089 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:26.948503 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ad0e58b-ae56-4038-80fd-c86c620f8089 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:27.094616 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7ad0e58b-ae56-4038-80fd-c86c620f8089 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:27.102783 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7ad0e58b-ae56-4038-80fd-c86c620f8089 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 200 len: 1313 microversion: 2.1 time: 0.168657 Aug 30 05:13:27.103377 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 117/219] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:26 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:27.350397 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6c6c2434-3845-4c78-a74d-657b9fe1daef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:27.351142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6c6c2434-3845-4c78-a74d-657b9fe1daef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:27.353520 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=8 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:27.358792 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c6c2434-3845-4c78-a74d-657b9fe1daef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:27.359514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c6c2434-3845-4c78-a74d-657b9fe1daef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:27.359875 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c6c2434-3845-4c78-a74d-657b9fe1daef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:27.360639 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c6c2434-3845-4c78-a74d-657b9fe1daef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:27.361163 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c6c2434-3845-4c78-a74d-657b9fe1daef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:27.361682 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c6c2434-3845-4c78-a74d-657b9fe1daef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:27.574517 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6c6c2434-3845-4c78-a74d-657b9fe1daef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:27.603025 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6c6c2434-3845-4c78-a74d-657b9fe1daef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.256927 Aug 30 05:13:27.621506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 103/220] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:27 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:28.123753 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f871a2e1-6202-4ab4-9d15-b06a48ce57c9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:28.124671 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f871a2e1-6202-4ab4-9d15-b06a48ce57c9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:28.132684 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f871a2e1-6202-4ab4-9d15-b06a48ce57c9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:28.134596 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f871a2e1-6202-4ab4-9d15-b06a48ce57c9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:28.135983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f871a2e1-6202-4ab4-9d15-b06a48ce57c9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:28.137186 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f871a2e1-6202-4ab4-9d15-b06a48ce57c9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:28.137798 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f871a2e1-6202-4ab4-9d15-b06a48ce57c9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:28.138374 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f871a2e1-6202-4ab4-9d15-b06a48ce57c9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:28.288599 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f871a2e1-6202-4ab4-9d15-b06a48ce57c9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:28.296196 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f871a2e1-6202-4ab4-9d15-b06a48ce57c9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 200 len: 1497 microversion: 2.1 time: 0.176504 Aug 30 05:13:28.296760 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 118/221] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:28 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:28.629115 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-76e3880b-4ef8-49f3-ab7c-5d7e8c6666bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:28.630293 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-76e3880b-4ef8-49f3-ab7c-5d7e8c6666bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:28.637492 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76e3880b-4ef8-49f3-ab7c-5d7e8c6666bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:28.638018 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76e3880b-4ef8-49f3-ab7c-5d7e8c6666bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:28.638618 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76e3880b-4ef8-49f3-ab7c-5d7e8c6666bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:28.639547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76e3880b-4ef8-49f3-ab7c-5d7e8c6666bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:28.640324 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76e3880b-4ef8-49f3-ab7c-5d7e8c6666bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:28.640904 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76e3880b-4ef8-49f3-ab7c-5d7e8c6666bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:28.844785 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-76e3880b-4ef8-49f3-ab7c-5d7e8c6666bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:28.854224 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-76e3880b-4ef8-49f3-ab7c-5d7e8c6666bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.230032 Aug 30 05:13:28.876485 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-68a5178b-9408-4918-8778-5f44054b9fde tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:28.877209 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-68a5178b-9408-4918-8778-5f44054b9fde tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:28.878931 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 104/222] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:28 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:28.884351 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68a5178b-9408-4918-8778-5f44054b9fde tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:28.885007 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68a5178b-9408-4918-8778-5f44054b9fde tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:28.885586 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68a5178b-9408-4918-8778-5f44054b9fde tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:28.886472 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68a5178b-9408-4918-8778-5f44054b9fde tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:28.887100 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68a5178b-9408-4918-8778-5f44054b9fde tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:28.887691 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68a5178b-9408-4918-8778-5f44054b9fde tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:28.918755 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-68a5178b-9408-4918-8778-5f44054b9fde tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:13:29.025308 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-68a5178b-9408-4918-8778-5f44054b9fde tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "DELETE /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 204 len: 0 microversion: 2.1 time: 0.153364 Aug 30 05:13:29.025985 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 119/223] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:13:28 2022] DELETE /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:13:29.038185 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ad8710cb-325e-4b61-adb8-983dea7ed6bf tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:29.039645 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ad8710cb-325e-4b61-adb8-983dea7ed6bf tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:29.047861 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad8710cb-325e-4b61-adb8-983dea7ed6bf tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:29.049542 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad8710cb-325e-4b61-adb8-983dea7ed6bf tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:29.050674 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad8710cb-325e-4b61-adb8-983dea7ed6bf tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:29.052135 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad8710cb-325e-4b61-adb8-983dea7ed6bf tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:29.053107 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad8710cb-325e-4b61-adb8-983dea7ed6bf tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:29.053711 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad8710cb-325e-4b61-adb8-983dea7ed6bf tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:29.237496 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ad8710cb-325e-4b61-adb8-983dea7ed6bf tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:29.245530 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ad8710cb-325e-4b61-adb8-983dea7ed6bf tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 200 len: 1503 microversion: 2.1 time: 0.212763 Aug 30 05:13:29.246402 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 105/224] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:29 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:29.875784 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9b109cff-812f-4ec6-a3a8-be8dce0a3517 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:29.876601 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9b109cff-812f-4ec6-a3a8-be8dce0a3517 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:29.882666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b109cff-812f-4ec6-a3a8-be8dce0a3517 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:29.883179 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b109cff-812f-4ec6-a3a8-be8dce0a3517 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:29.883612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b109cff-812f-4ec6-a3a8-be8dce0a3517 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:29.884400 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b109cff-812f-4ec6-a3a8-be8dce0a3517 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:29.884844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b109cff-812f-4ec6-a3a8-be8dce0a3517 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:29.885260 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b109cff-812f-4ec6-a3a8-be8dce0a3517 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:30.026573 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9b109cff-812f-4ec6-a3a8-be8dce0a3517 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:30.036331 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9b109cff-812f-4ec6-a3a8-be8dce0a3517 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.164919 Aug 30 05:13:30.036906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 120/225] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:29 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:30.267446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-315acde1-d269-4ade-af6e-055c932ef2fd tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:30.268568 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-315acde1-d269-4ade-af6e-055c932ef2fd tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:30.275157 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-315acde1-d269-4ade-af6e-055c932ef2fd tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:30.275633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-315acde1-d269-4ade-af6e-055c932ef2fd tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:30.276302 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-315acde1-d269-4ade-af6e-055c932ef2fd tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:30.277045 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-315acde1-d269-4ade-af6e-055c932ef2fd tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:30.277726 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-315acde1-d269-4ade-af6e-055c932ef2fd tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:30.278162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-315acde1-d269-4ade-af6e-055c932ef2fd tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:30.419615 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-315acde1-d269-4ade-af6e-055c932ef2fd tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:30.429263 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-315acde1-d269-4ade-af6e-055c932ef2fd tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 200 len: 1503 microversion: 2.1 time: 0.165606 Aug 30 05:13:30.429843 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 106/226] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:30 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:30.672660 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1071041066", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:30.731673 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] validate_networks() for None {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:13:31.043469 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:13:31.044042 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:13:31.044342 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:13:31.044864 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:13:31.045132 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:13:31.057524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8cd032b5-57c7-49d9-90d7-68f92e97bc04 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:31.058570 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8cd032b5-57c7-49d9-90d7-68f92e97bc04 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:31.065853 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:31.066329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:31.068107 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cd032b5-57c7-49d9-90d7-68f92e97bc04 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:31.068800 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cd032b5-57c7-49d9-90d7-68f92e97bc04 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:31.069474 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cd032b5-57c7-49d9-90d7-68f92e97bc04 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:31.070466 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cd032b5-57c7-49d9-90d7-68f92e97bc04 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:31.071283 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:31.071903 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cd032b5-57c7-49d9-90d7-68f92e97bc04 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:31.072567 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cd032b5-57c7-49d9-90d7-68f92e97bc04 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:31.073283 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:31.073728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:31.075456 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:31.098189 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Getting quotas for project 5ba05d601a9240bb922f4d6dc3cc6bc6. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:13:31.102645 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Getting quotas for user 71e9c605498544c8b6c75349d9b66a94 and project 5ba05d601a9240bb922f4d6dc3cc6bc6. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:13:31.118024 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:13:31.121134 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:13:31.186697 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c0492cae-45ea-4d7b-8ae5-0a465ac3605b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517389 Aug 30 05:13:31.190045 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 121/227] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:13:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:13:31.204557 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9b7dee79-a451-419c-a310-98ef8df3c924 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:31.205426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9b7dee79-a451-419c-a310-98ef8df3c924 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:31.264075 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9b7dee79-a451-419c-a310-98ef8df3c924 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:31.271903 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9b7dee79-a451-419c-a310-98ef8df3c924 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1215 microversion: 2.1 time: 0.071922 Aug 30 05:13:31.273584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 122/228] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:31 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:31.379124 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8cd032b5-57c7-49d9-90d7-68f92e97bc04 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:31.387314 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8cd032b5-57c7-49d9-90d7-68f92e97bc04 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.333359 Aug 30 05:13:31.388170 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 107/229] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:31 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:31.434561 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-bb607d11-cf32-4cc6-bd7a-aa9b9225e6bf req-e289179b-378e-430a-8b00-c654f5603f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "209cce85-549b-4cdd-8228-f9d3b40dd030", "name": "network-vif-deleted", "tag": "9529616f-ee1b-4e04-bee9-facc87ae87f6"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:31.445794 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bb607d11-cf32-4cc6-bd7a-aa9b9225e6bf req-e289179b-378e-430a-8b00-c654f5603f3c service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:31.446288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bb607d11-cf32-4cc6-bd7a-aa9b9225e6bf req-e289179b-378e-430a-8b00-c654f5603f3c service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:31.446712 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bb607d11-cf32-4cc6-bd7a-aa9b9225e6bf req-e289179b-378e-430a-8b00-c654f5603f3c service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:31.453440 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ee6396fb-bd75-4386-8096-f0d44495cc4b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:31.454321 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ee6396fb-bd75-4386-8096-f0d44495cc4b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:31.465873 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee6396fb-bd75-4386-8096-f0d44495cc4b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:31.467217 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee6396fb-bd75-4386-8096-f0d44495cc4b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:31.468127 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee6396fb-bd75-4386-8096-f0d44495cc4b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:31.469835 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee6396fb-bd75-4386-8096-f0d44495cc4b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:31.470537 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee6396fb-bd75-4386-8096-f0d44495cc4b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:31.471648 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee6396fb-bd75-4386-8096-f0d44495cc4b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:31.479118 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-bb607d11-cf32-4cc6-bd7a-aa9b9225e6bf req-e289179b-378e-430a-8b00-c654f5603f3c service nova] Creating event network-vif-deleted:9529616f-ee1b-4e04-bee9-facc87ae87f6 for instance 209cce85-549b-4cdd-8228-f9d3b40dd030 on hv-cinder-85391 Aug 30 05:13:31.487355 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-bb607d11-cf32-4cc6-bd7a-aa9b9225e6bf req-e289179b-378e-430a-8b00-c654f5603f3c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056201 Aug 30 05:13:31.488301 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 123/230] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:31.555022 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ee6396fb-bd75-4386-8096-f0d44495cc4b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:31.563846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ee6396fb-bd75-4386-8096-f0d44495cc4b tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 200 len: 1461 microversion: 2.1 time: 0.116827 Aug 30 05:13:31.564434 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 108/231] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:31 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 1461 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:32.294058 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5514cc33-55d8-438c-a1f8-ae72e736e104 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:32.294765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5514cc33-55d8-438c-a1f8-ae72e736e104 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:32.300818 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5514cc33-55d8-438c-a1f8-ae72e736e104 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:32.301351 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5514cc33-55d8-438c-a1f8-ae72e736e104 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:32.301718 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5514cc33-55d8-438c-a1f8-ae72e736e104 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:32.302409 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5514cc33-55d8-438c-a1f8-ae72e736e104 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:32.302892 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5514cc33-55d8-438c-a1f8-ae72e736e104 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:32.303326 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5514cc33-55d8-438c-a1f8-ae72e736e104 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:32.366890 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5514cc33-55d8-438c-a1f8-ae72e736e104 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:32.374390 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5514cc33-55d8-438c-a1f8-ae72e736e104 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1219 microversion: 2.1 time: 0.084484 Aug 30 05:13:32.374983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 124/232] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:32 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:32.409249 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d0b5101c-b9b6-4c3c-afa7-2dc7197c3c15 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:32.409865 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d0b5101c-b9b6-4c3c-afa7-2dc7197c3c15 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:32.416221 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0b5101c-b9b6-4c3c-afa7-2dc7197c3c15 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:32.416712 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0b5101c-b9b6-4c3c-afa7-2dc7197c3c15 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:32.417148 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0b5101c-b9b6-4c3c-afa7-2dc7197c3c15 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:32.417840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0b5101c-b9b6-4c3c-afa7-2dc7197c3c15 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:32.418294 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0b5101c-b9b6-4c3c-afa7-2dc7197c3c15 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:32.418717 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0b5101c-b9b6-4c3c-afa7-2dc7197c3c15 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:32.556166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d0b5101c-b9b6-4c3c-afa7-2dc7197c3c15 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:32.563904 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d0b5101c-b9b6-4c3c-afa7-2dc7197c3c15 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.158711 Aug 30 05:13:32.565089 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 109/233] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:32 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:32.584417 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9087ec0f-bca3-44b5-9157-afb93147ff00 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:32.585230 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9087ec0f-bca3-44b5-9157-afb93147ff00 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:32.591079 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9087ec0f-bca3-44b5-9157-afb93147ff00 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:32.591556 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9087ec0f-bca3-44b5-9157-afb93147ff00 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:32.591983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9087ec0f-bca3-44b5-9157-afb93147ff00 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:32.592660 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9087ec0f-bca3-44b5-9157-afb93147ff00 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:32.593106 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9087ec0f-bca3-44b5-9157-afb93147ff00 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:32.593523 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9087ec0f-bca3-44b5-9157-afb93147ff00 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:32.658331 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9087ec0f-bca3-44b5-9157-afb93147ff00 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:32.665922 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9087ec0f-bca3-44b5-9157-afb93147ff00 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 200 len: 1298 microversion: 2.1 time: 0.085371 Aug 30 05:13:32.666482 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 125/234] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:32 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:33.394785 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-798811f1-5546-4766-b0e7-b35e21093598 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:33.395420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-798811f1-5546-4766-b0e7-b35e21093598 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:33.401276 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-798811f1-5546-4766-b0e7-b35e21093598 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:33.401761 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-798811f1-5546-4766-b0e7-b35e21093598 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:33.402192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-798811f1-5546-4766-b0e7-b35e21093598 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:33.402899 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-798811f1-5546-4766-b0e7-b35e21093598 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:33.403341 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-798811f1-5546-4766-b0e7-b35e21093598 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:33.403768 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-798811f1-5546-4766-b0e7-b35e21093598 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:33.473640 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-798811f1-5546-4766-b0e7-b35e21093598 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:33.481360 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-798811f1-5546-4766-b0e7-b35e21093598 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1219 microversion: 2.1 time: 0.090769 Aug 30 05:13:33.481929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 110/235] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:33 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:33.585295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d7576d9b-cad4-4cf8-9d13-220778bce313 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:33.585911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d7576d9b-cad4-4cf8-9d13-220778bce313 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:33.591933 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7576d9b-cad4-4cf8-9d13-220778bce313 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:33.592417 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7576d9b-cad4-4cf8-9d13-220778bce313 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:33.592849 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7576d9b-cad4-4cf8-9d13-220778bce313 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:33.593541 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7576d9b-cad4-4cf8-9d13-220778bce313 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:33.594248 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7576d9b-cad4-4cf8-9d13-220778bce313 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:33.601505 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d7576d9b-cad4-4cf8-9d13-220778bce313 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:33.687379 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a443a1f7-02ec-4abd-b853-86b83cf90341 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:33.688060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a443a1f7-02ec-4abd-b853-86b83cf90341 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:33.694543 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a443a1f7-02ec-4abd-b853-86b83cf90341 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:33.695077 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a443a1f7-02ec-4abd-b853-86b83cf90341 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:33.695520 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a443a1f7-02ec-4abd-b853-86b83cf90341 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:33.696278 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a443a1f7-02ec-4abd-b853-86b83cf90341 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:33.696743 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a443a1f7-02ec-4abd-b853-86b83cf90341 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:33.697174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a443a1f7-02ec-4abd-b853-86b83cf90341 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:33.753664 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d7576d9b-cad4-4cf8-9d13-220778bce313 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:33.768252 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d7576d9b-cad4-4cf8-9d13-220778bce313 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.185865 Aug 30 05:13:33.769167 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 126/236] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:33 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:33.812427 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a443a1f7-02ec-4abd-b853-86b83cf90341 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:33.821825 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a443a1f7-02ec-4abd-b853-86b83cf90341 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 200 len: 1298 microversion: 2.1 time: 0.138461 Aug 30 05:13:33.822398 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 111/237] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:33 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 1298 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:34.503309 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2f563bcf-f52d-4713-8e38-a53b76212f8b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:34.503927 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2f563bcf-f52d-4713-8e38-a53b76212f8b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:34.511403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f563bcf-f52d-4713-8e38-a53b76212f8b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:34.512568 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f563bcf-f52d-4713-8e38-a53b76212f8b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:34.514023 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f563bcf-f52d-4713-8e38-a53b76212f8b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:34.514905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f563bcf-f52d-4713-8e38-a53b76212f8b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:34.515548 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f563bcf-f52d-4713-8e38-a53b76212f8b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:34.516308 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2f563bcf-f52d-4713-8e38-a53b76212f8b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:34.585078 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2f563bcf-f52d-4713-8e38-a53b76212f8b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:34.593403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2f563bcf-f52d-4713-8e38-a53b76212f8b tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1267 microversion: 2.1 time: 0.095535 Aug 30 05:13:34.595163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 127/238] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:34 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1267 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:34.789792 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f852ef6f-31d3-40b7-adb6-fdbfd6d5b591 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:34.790347 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f852ef6f-31d3-40b7-adb6-fdbfd6d5b591 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:34.796553 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f852ef6f-31d3-40b7-adb6-fdbfd6d5b591 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:34.797043 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f852ef6f-31d3-40b7-adb6-fdbfd6d5b591 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:34.797483 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f852ef6f-31d3-40b7-adb6-fdbfd6d5b591 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:34.798179 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f852ef6f-31d3-40b7-adb6-fdbfd6d5b591 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:34.798668 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f852ef6f-31d3-40b7-adb6-fdbfd6d5b591 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:34.799131 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f852ef6f-31d3-40b7-adb6-fdbfd6d5b591 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:34.842763 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ece85a31-8bc9-4898-bae0-f3f544609c2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:34.844414 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ece85a31-8bc9-4898-bae0-f3f544609c2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 209cce85-549b-4cdd-8228-f9d3b40dd030] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:34.851350 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ece85a31-8bc9-4898-bae0-f3f544609c2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:34.852038 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ece85a31-8bc9-4898-bae0-f3f544609c2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:34.852615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ece85a31-8bc9-4898-bae0-f3f544609c2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:34.853468 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ece85a31-8bc9-4898-bae0-f3f544609c2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:34.854059 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ece85a31-8bc9-4898-bae0-f3f544609c2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:34.854621 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ece85a31-8bc9-4898-bae0-f3f544609c2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:34.870730 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-ece85a31-8bc9-4898-bae0-f3f544609c2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] HTTP exception thrown: Instance 209cce85-549b-4cdd-8228-f9d3b40dd030 could not be found. Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ece85a31-8bc9-4898-bae0-f3f544609c2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Request method failure captured: Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 HTTP/1.1 Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZxk6t2tUyMCy8dtozHuFOpPExbYagNpH1d_FcAmdfOUulvhVxqC0AIlTNy2suSQAroskCI2nqc4nP54nwajh2Ukv02Jkg2fJEbcl3J29VSFbwJFSdaCDgH9XuNvG09PDG5vLSVwGOxOA-dAgoSmAvfTPUSORj50Hw0FlwqKU-PhsGk Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 9cea756f95e843b5868e53f6446d648a Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesActionsTest-1374801759 Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:13:34.872381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:13:34.873706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/9cea756f95e843b5868e53f6446d648a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/9cea756f95e843b5868e53f6446d648a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/9cea756f95e843b5868e53f6446d648a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_9cea756f95e843b5868e53f6446d648a", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:13:34.873706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesActionsTest-1374801759 Aug 30 05:13:34.873706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 9cea756f95e843b5868e53f6446d648a Aug 30 05:13:34.873706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesActionsTest-1374801759 Aug 30 05:13:34.873706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesActionsTest-1374801759-project Aug 30 05:13:34.873706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:13:34.873706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:13:34.873706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: b50d70f00f33494e81d4aac49df96dc4 Aug 30 05:13:34.873706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesActionsTest-1374801759-project Aug 30 05:13:34.873706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:13:34.873706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 209cce85-549b-4cdd-8228-f9d3b40dd030 could not be found. Aug 30 05:13:34.873706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '209cce85-549b-4cdd-8228-f9d3b40dd030'} Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 209cce85-549b-4cdd-8228-f9d3b40dd030 could not be found. Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:13:34.874429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 209cce85-549b-4cdd-8228-f9d3b40dd030 could not be found. Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 209cce85-549b-4cdd-8228-f9d3b40dd030 could not be found. Aug 30 05:13:34.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:34.877696 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ece85a31-8bc9-4898-bae0-f3f544609c2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Returning 404 to user: Instance 209cce85-549b-4cdd-8228-f9d3b40dd030 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:13:34.877696 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ece85a31-8bc9-4898-bae0-f3f544609c2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030" status: 404 len: 111 microversion: 2.1 time: 0.034808 Aug 30 05:13:34.877696 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 128/239] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:34 2022] GET /compute/v2.1/servers/209cce85-549b-4cdd-8228-f9d3b40dd030 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:13:34.991779 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f852ef6f-31d3-40b7-adb6-fdbfd6d5b591 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:35.001192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f852ef6f-31d3-40b7-adb6-fdbfd6d5b591 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.215225 Aug 30 05:13:35.002290 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 112/240] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:34 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:35.014373 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-869536097", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452", "networks": [{"uuid": "e7f9908e-0aa3-4c4d-a73a-efe9fe4198e5"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:35.075830 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] validate_networks() for [('e7f9908e-0aa3-4c4d-a73a-efe9fe4198e5', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:13:35.483266 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:13:35.483682 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:13:35.484577 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:13:35.484784 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:13:35.485196 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:13:35.498544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:35.499161 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:35.499589 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:35.500303 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:35.500747 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:35.501160 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:35.519053 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Getting quotas for project 9cea756f95e843b5868e53f6446d648a. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:13:35.523222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Getting quotas for user b50d70f00f33494e81d4aac49df96dc4 and project 9cea756f95e843b5868e53f6446d648a. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:13:35.535611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:13:35.538123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:13:35.596555 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bc4bd36c-cd36-4e0f-b523-8ade7f7d0eb9 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585889 Aug 30 05:13:35.603909 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 129/241] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:13:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:13:35.609092 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4eba01a5-3083-4783-8e45-347ab0670d55 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:35.609844 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4eba01a5-3083-4783-8e45-347ab0670d55 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:35.616218 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2fb2076b-649b-4b3e-a64b-d0e90c0e8e59 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:35.616841 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2fb2076b-649b-4b3e-a64b-d0e90c0e8e59 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:35.629249 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fb2076b-649b-4b3e-a64b-d0e90c0e8e59 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:35.631161 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fb2076b-649b-4b3e-a64b-d0e90c0e8e59 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:35.645453 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fb2076b-649b-4b3e-a64b-d0e90c0e8e59 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:35.646680 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fb2076b-649b-4b3e-a64b-d0e90c0e8e59 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:35.647202 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fb2076b-649b-4b3e-a64b-d0e90c0e8e59 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:35.647642 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fb2076b-649b-4b3e-a64b-d0e90c0e8e59 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:35.666622 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4eba01a5-3083-4783-8e45-347ab0670d55 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:35.674359 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4eba01a5-3083-4783-8e45-347ab0670d55 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1213 microversion: 2.1 time: 0.068508 Aug 30 05:13:35.675371 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 113/242] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:35 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:35.740693 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2fb2076b-649b-4b3e-a64b-d0e90c0e8e59 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:35.748816 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2fb2076b-649b-4b3e-a64b-d0e90c0e8e59 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1267 microversion: 2.1 time: 0.136542 Aug 30 05:13:35.750861 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 130/243] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:35 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:36.023363 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6062d8c2-221d-4f07-a065-0a5a5cac75e6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:36.024578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6062d8c2-221d-4f07-a065-0a5a5cac75e6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:36.032221 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6062d8c2-221d-4f07-a065-0a5a5cac75e6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:36.032778 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6062d8c2-221d-4f07-a065-0a5a5cac75e6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:36.033930 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6062d8c2-221d-4f07-a065-0a5a5cac75e6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:36.034976 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6062d8c2-221d-4f07-a065-0a5a5cac75e6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:36.035497 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6062d8c2-221d-4f07-a065-0a5a5cac75e6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:36.035999 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6062d8c2-221d-4f07-a065-0a5a5cac75e6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:36.172047 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6062d8c2-221d-4f07-a065-0a5a5cac75e6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:36.179846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6062d8c2-221d-4f07-a065-0a5a5cac75e6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.161483 Aug 30 05:13:36.180414 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 114/244] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:36 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:36.695911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-33a99245-93a5-4563-94a5-02dd05b04345 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:36.696591 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-33a99245-93a5-4563-94a5-02dd05b04345 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:36.702383 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33a99245-93a5-4563-94a5-02dd05b04345 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:36.702959 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33a99245-93a5-4563-94a5-02dd05b04345 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:36.703386 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33a99245-93a5-4563-94a5-02dd05b04345 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:36.704062 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33a99245-93a5-4563-94a5-02dd05b04345 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:36.704502 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33a99245-93a5-4563-94a5-02dd05b04345 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:36.705542 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33a99245-93a5-4563-94a5-02dd05b04345 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:36.769941 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3c2d2105-a3b9-4989-b665-9a32cefef86f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:36.770548 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3c2d2105-a3b9-4989-b665-9a32cefef86f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:36.776648 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c2d2105-a3b9-4989-b665-9a32cefef86f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:36.776953 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-33a99245-93a5-4563-94a5-02dd05b04345 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:36.777131 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c2d2105-a3b9-4989-b665-9a32cefef86f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:36.777733 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c2d2105-a3b9-4989-b665-9a32cefef86f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:36.778420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c2d2105-a3b9-4989-b665-9a32cefef86f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:36.778893 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c2d2105-a3b9-4989-b665-9a32cefef86f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:36.779316 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3c2d2105-a3b9-4989-b665-9a32cefef86f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:36.784690 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-33a99245-93a5-4563-94a5-02dd05b04345 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1217 microversion: 2.1 time: 0.092294 Aug 30 05:13:36.785030 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 131/245] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:36 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:36.841912 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3c2d2105-a3b9-4989-b665-9a32cefef86f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:36.849832 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3c2d2105-a3b9-4989-b665-9a32cefef86f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1267 microversion: 2.1 time: 0.084429 Aug 30 05:13:36.863017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 115/246] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:36 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:37.200929 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6f2bcdd1-7ee3-426d-9468-bf40a9634cd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:37.201480 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6f2bcdd1-7ee3-426d-9468-bf40a9634cd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:37.207415 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f2bcdd1-7ee3-426d-9468-bf40a9634cd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:37.207898 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f2bcdd1-7ee3-426d-9468-bf40a9634cd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:37.208338 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f2bcdd1-7ee3-426d-9468-bf40a9634cd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:37.209023 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f2bcdd1-7ee3-426d-9468-bf40a9634cd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:37.209485 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f2bcdd1-7ee3-426d-9468-bf40a9634cd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:37.209910 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6f2bcdd1-7ee3-426d-9468-bf40a9634cd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:37.333633 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6f2bcdd1-7ee3-426d-9468-bf40a9634cd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:37.341254 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6f2bcdd1-7ee3-426d-9468-bf40a9634cd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.144271 Aug 30 05:13:37.341810 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 132/247] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:37 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:37.805602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0fc634c7-7ba3-47d3-a535-19feb380ac2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:37.806264 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0fc634c7-7ba3-47d3-a535-19feb380ac2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:37.812995 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fc634c7-7ba3-47d3-a535-19feb380ac2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:37.813636 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fc634c7-7ba3-47d3-a535-19feb380ac2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:37.813919 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fc634c7-7ba3-47d3-a535-19feb380ac2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:37.814639 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fc634c7-7ba3-47d3-a535-19feb380ac2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:37.815145 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fc634c7-7ba3-47d3-a535-19feb380ac2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:37.815575 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0fc634c7-7ba3-47d3-a535-19feb380ac2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:37.835649 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:37.871948 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-abc682ad-a577-4495-ac3a-e67f0302c05e tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:37.872685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-abc682ad-a577-4495-ac3a-e67f0302c05e tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:37.878979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abc682ad-a577-4495-ac3a-e67f0302c05e tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:37.879679 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abc682ad-a577-4495-ac3a-e67f0302c05e tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:37.880062 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abc682ad-a577-4495-ac3a-e67f0302c05e tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:37.880839 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abc682ad-a577-4495-ac3a-e67f0302c05e tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:37.881444 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abc682ad-a577-4495-ac3a-e67f0302c05e tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:37.882382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-abc682ad-a577-4495-ac3a-e67f0302c05e tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:37.964145 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-abc682ad-a577-4495-ac3a-e67f0302c05e tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:37.973912 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-abc682ad-a577-4495-ac3a-e67f0302c05e tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1273 microversion: 2.1 time: 0.105855 Aug 30 05:13:37.987985 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 133/248] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:37 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1273 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:38.003962 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0fc634c7-7ba3-47d3-a535-19feb380ac2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:38.012027 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0fc634c7-7ba3-47d3-a535-19feb380ac2f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1265 microversion: 2.1 time: 0.210259 Aug 30 05:13:38.012618 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 116/249] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:37 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:38.362633 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-77dd0802-2120-4a30-af6d-0f0e7c08990b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:38.363436 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-77dd0802-2120-4a30-af6d-0f0e7c08990b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:38.369509 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77dd0802-2120-4a30-af6d-0f0e7c08990b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:38.370096 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77dd0802-2120-4a30-af6d-0f0e7c08990b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:38.370654 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77dd0802-2120-4a30-af6d-0f0e7c08990b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:38.371389 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77dd0802-2120-4a30-af6d-0f0e7c08990b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:38.371839 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77dd0802-2120-4a30-af6d-0f0e7c08990b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:38.372255 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-77dd0802-2120-4a30-af6d-0f0e7c08990b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:38.519764 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-77dd0802-2120-4a30-af6d-0f0e7c08990b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:38.523537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:38.528774 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-77dd0802-2120-4a30-af6d-0f0e7c08990b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.170050 Aug 30 05:13:38.529715 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 134/250] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:38 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:39.001346 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c2ec7eb0-3a6d-47fc-b5e4-b953abd4a775 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:39.003600 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c2ec7eb0-3a6d-47fc-b5e4-b953abd4a775 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:39.012776 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2ec7eb0-3a6d-47fc-b5e4-b953abd4a775 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:39.013455 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2ec7eb0-3a6d-47fc-b5e4-b953abd4a775 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:39.013927 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2ec7eb0-3a6d-47fc-b5e4-b953abd4a775 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:39.014623 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2ec7eb0-3a6d-47fc-b5e4-b953abd4a775 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:39.015112 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2ec7eb0-3a6d-47fc-b5e4-b953abd4a775 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:39.015542 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2ec7eb0-3a6d-47fc-b5e4-b953abd4a775 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:39.043901 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-372bbc72-159d-41c4-8e60-6150ce3b10c3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:39.045118 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-372bbc72-159d-41c4-8e60-6150ce3b10c3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:39.052884 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-372bbc72-159d-41c4-8e60-6150ce3b10c3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:39.053356 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-372bbc72-159d-41c4-8e60-6150ce3b10c3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:39.054006 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-372bbc72-159d-41c4-8e60-6150ce3b10c3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:39.054718 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-372bbc72-159d-41c4-8e60-6150ce3b10c3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:39.055391 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-372bbc72-159d-41c4-8e60-6150ce3b10c3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:39.055830 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-372bbc72-159d-41c4-8e60-6150ce3b10c3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:39.129959 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-372bbc72-159d-41c4-8e60-6150ce3b10c3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:39.138457 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-372bbc72-159d-41c4-8e60-6150ce3b10c3 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1271 microversion: 2.1 time: 0.099432 Aug 30 05:13:39.139295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 135/251] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:39 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:39.327563 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c2ec7eb0-3a6d-47fc-b5e4-b953abd4a775 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:39.338034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c2ec7eb0-3a6d-47fc-b5e4-b953abd4a775 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1315 microversion: 2.1 time: 0.343603 Aug 30 05:13:39.340948 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 117/252] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:38 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:39.550924 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-61563237-d2ba-473e-8e96-2ced24eea889 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:39.551923 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-61563237-d2ba-473e-8e96-2ced24eea889 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:39.558953 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61563237-d2ba-473e-8e96-2ced24eea889 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:39.559447 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61563237-d2ba-473e-8e96-2ced24eea889 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:39.559881 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61563237-d2ba-473e-8e96-2ced24eea889 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:39.560618 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61563237-d2ba-473e-8e96-2ced24eea889 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:39.561068 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61563237-d2ba-473e-8e96-2ced24eea889 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:39.561496 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61563237-d2ba-473e-8e96-2ced24eea889 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:39.699051 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-61563237-d2ba-473e-8e96-2ced24eea889 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:39.706700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-61563237-d2ba-473e-8e96-2ced24eea889 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.160995 Aug 30 05:13:39.707324 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 136/253] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:39 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:40.105638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-8b6f330e-0c51-4e17-ab99-6f47647e0414 req-f051cce8-9ffe-4035-a32d-357db7f10fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd0e6d54-d23a-4a22-a5ab-9a224a71b460", "tag": "ace1ce2c-60f2-4276-97c3-6f26d166aceb"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:40.121111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-8b6f330e-0c51-4e17-ab99-6f47647e0414 req-f051cce8-9ffe-4035-a32d-357db7f10fbf service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:40.136134 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-8b6f330e-0c51-4e17-ab99-6f47647e0414 req-f051cce8-9ffe-4035-a32d-357db7f10fbf service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:40.136956 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-8b6f330e-0c51-4e17-ab99-6f47647e0414 req-f051cce8-9ffe-4035-a32d-357db7f10fbf service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:40.155073 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-8b6f330e-0c51-4e17-ab99-6f47647e0414 req-f051cce8-9ffe-4035-a32d-357db7f10fbf service nova] Creating event network-changed:ace1ce2c-60f2-4276-97c3-6f26d166aceb for instance bd0e6d54-d23a-4a22-a5ab-9a224a71b460 on hv-cinder-85391 Aug 30 05:13:40.162175 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-de225e97-722c-47f3-b8d7-97931056312e tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:40.163147 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-de225e97-722c-47f3-b8d7-97931056312e tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:40.164219 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-8b6f330e-0c51-4e17-ab99-6f47647e0414 req-f051cce8-9ffe-4035-a32d-357db7f10fbf service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060670 Aug 30 05:13:40.166917 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 118/254] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:40.179892 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de225e97-722c-47f3-b8d7-97931056312e tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:40.180421 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de225e97-722c-47f3-b8d7-97931056312e tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:40.181092 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de225e97-722c-47f3-b8d7-97931056312e tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:40.181890 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de225e97-722c-47f3-b8d7-97931056312e tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:40.182552 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de225e97-722c-47f3-b8d7-97931056312e tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:40.183106 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de225e97-722c-47f3-b8d7-97931056312e tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:40.349911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-de225e97-722c-47f3-b8d7-97931056312e tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:40.361774 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6185cd92-ca25-423a-8727-17a99778c3c1 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:40.363124 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6185cd92-ca25-423a-8727-17a99778c3c1 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:40.370608 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-de225e97-722c-47f3-b8d7-97931056312e tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1313 microversion: 2.1 time: 0.213290 Aug 30 05:13:40.372534 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6185cd92-ca25-423a-8727-17a99778c3c1 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:40.373299 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 137/255] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:40 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:40.374055 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6185cd92-ca25-423a-8727-17a99778c3c1 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:40.374656 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6185cd92-ca25-423a-8727-17a99778c3c1 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:40.375695 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6185cd92-ca25-423a-8727-17a99778c3c1 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:40.376225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6185cd92-ca25-423a-8727-17a99778c3c1 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:40.377195 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6185cd92-ca25-423a-8727-17a99778c3c1 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:40.678127 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6185cd92-ca25-423a-8727-17a99778c3c1 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:40.693830 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6185cd92-ca25-423a-8727-17a99778c3c1 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1315 microversion: 2.1 time: 0.336415 Aug 30 05:13:40.699283 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 119/256] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:40 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:40.728143 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9436d0a4-5104-4505-a486-36c196260f38 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:40.728757 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9436d0a4-5104-4505-a486-36c196260f38 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:40.734949 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9436d0a4-5104-4505-a486-36c196260f38 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:40.735628 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9436d0a4-5104-4505-a486-36c196260f38 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:40.736926 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9436d0a4-5104-4505-a486-36c196260f38 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:40.737884 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9436d0a4-5104-4505-a486-36c196260f38 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:40.738541 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9436d0a4-5104-4505-a486-36c196260f38 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:40.739193 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9436d0a4-5104-4505-a486-36c196260f38 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:40.942218 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9436d0a4-5104-4505-a486-36c196260f38 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:40.951258 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9436d0a4-5104-4505-a486-36c196260f38 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.226870 Aug 30 05:13:40.952083 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 138/257] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:40 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:41.395818 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-53494087-b781-47de-8fc8-7928ebc3166f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:41.396837 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-53494087-b781-47de-8fc8-7928ebc3166f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:41.403681 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53494087-b781-47de-8fc8-7928ebc3166f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:41.404378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53494087-b781-47de-8fc8-7928ebc3166f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:41.404587 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53494087-b781-47de-8fc8-7928ebc3166f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:41.405389 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53494087-b781-47de-8fc8-7928ebc3166f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:41.405786 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53494087-b781-47de-8fc8-7928ebc3166f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:41.406337 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-53494087-b781-47de-8fc8-7928ebc3166f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:41.570046 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-53494087-b781-47de-8fc8-7928ebc3166f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:41.580416 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-53494087-b781-47de-8fc8-7928ebc3166f tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1313 microversion: 2.1 time: 0.189775 Aug 30 05:13:41.586491 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 120/258] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:41 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:41.719057 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-67e3b8c3-f7c1-4ecd-8aa1-849800de2fd8 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:41.719680 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-67e3b8c3-f7c1-4ecd-8aa1-849800de2fd8 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:41.733877 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67e3b8c3-f7c1-4ecd-8aa1-849800de2fd8 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:41.735567 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67e3b8c3-f7c1-4ecd-8aa1-849800de2fd8 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:41.738304 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67e3b8c3-f7c1-4ecd-8aa1-849800de2fd8 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:41.739854 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67e3b8c3-f7c1-4ecd-8aa1-849800de2fd8 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:41.741037 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67e3b8c3-f7c1-4ecd-8aa1-849800de2fd8 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:41.743232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-67e3b8c3-f7c1-4ecd-8aa1-849800de2fd8 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:41.972628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2a24fc28-d25c-496f-9b0f-af5b05e50070 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:41.973530 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2a24fc28-d25c-496f-9b0f-af5b05e50070 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:41.979939 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a24fc28-d25c-496f-9b0f-af5b05e50070 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:41.980883 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a24fc28-d25c-496f-9b0f-af5b05e50070 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:41.981490 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a24fc28-d25c-496f-9b0f-af5b05e50070 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:41.982527 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a24fc28-d25c-496f-9b0f-af5b05e50070 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:41.983191 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a24fc28-d25c-496f-9b0f-af5b05e50070 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:41.983937 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a24fc28-d25c-496f-9b0f-af5b05e50070 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:42.005007 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-67e3b8c3-f7c1-4ecd-8aa1-849800de2fd8 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:42.017003 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-67e3b8c3-f7c1-4ecd-8aa1-849800de2fd8 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1315 microversion: 2.1 time: 0.303198 Aug 30 05:13:42.023185 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 139/259] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:41 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:42.204483 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-6897bb69-326c-4a06-b313-c3844a52a625 req-f810505b-c6ce-46ff-82a6-718f02567c33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "792da216-65d1-4514-8eca-250051397974", "tag": "38cd1a99-b826-46f6-973e-bf6c13f95335"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:42.216088 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-6897bb69-326c-4a06-b313-c3844a52a625 req-f810505b-c6ce-46ff-82a6-718f02567c33 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:42.216951 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-6897bb69-326c-4a06-b313-c3844a52a625 req-f810505b-c6ce-46ff-82a6-718f02567c33 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:42.217401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-6897bb69-326c-4a06-b313-c3844a52a625 req-f810505b-c6ce-46ff-82a6-718f02567c33 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:42.230776 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-6897bb69-326c-4a06-b313-c3844a52a625 req-f810505b-c6ce-46ff-82a6-718f02567c33 service nova] Creating event network-changed:38cd1a99-b826-46f6-973e-bf6c13f95335 for instance 792da216-65d1-4514-8eca-250051397974 on hv-cinder-85391 Aug 30 05:13:42.237528 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-6897bb69-326c-4a06-b313-c3844a52a625 req-f810505b-c6ce-46ff-82a6-718f02567c33 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035956 Aug 30 05:13:42.238644 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 140/260] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:42.261823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2a24fc28-d25c-496f-9b0f-af5b05e50070 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:42.270960 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2a24fc28-d25c-496f-9b0f-af5b05e50070 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.302375 Aug 30 05:13:42.271615 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 121/261] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:41 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:42.602209 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2e66c4d5-7833-402a-8aba-5a786c81ea64 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:42.602932 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2e66c4d5-7833-402a-8aba-5a786c81ea64 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:42.609356 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2e66c4d5-7833-402a-8aba-5a786c81ea64 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:42.609706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2e66c4d5-7833-402a-8aba-5a786c81ea64 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:42.610143 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2e66c4d5-7833-402a-8aba-5a786c81ea64 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:42.610856 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2e66c4d5-7833-402a-8aba-5a786c81ea64 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:42.611541 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2e66c4d5-7833-402a-8aba-5a786c81ea64 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:42.611978 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2e66c4d5-7833-402a-8aba-5a786c81ea64 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:42.748157 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2e66c4d5-7833-402a-8aba-5a786c81ea64 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:42.755689 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2e66c4d5-7833-402a-8aba-5a786c81ea64 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1313 microversion: 2.1 time: 0.157926 Aug 30 05:13:42.756259 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 141/262] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:42 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:43.041565 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f4a75947-0c70-4c7a-805c-d49502b9cb41 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:43.042184 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f4a75947-0c70-4c7a-805c-d49502b9cb41 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:43.049036 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4a75947-0c70-4c7a-805c-d49502b9cb41 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:43.049641 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4a75947-0c70-4c7a-805c-d49502b9cb41 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:43.050088 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4a75947-0c70-4c7a-805c-d49502b9cb41 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:43.050783 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4a75947-0c70-4c7a-805c-d49502b9cb41 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:43.051265 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4a75947-0c70-4c7a-805c-d49502b9cb41 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:43.051741 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4a75947-0c70-4c7a-805c-d49502b9cb41 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:43.192438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f4a75947-0c70-4c7a-805c-d49502b9cb41 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:43.202535 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f4a75947-0c70-4c7a-805c-d49502b9cb41 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1315 microversion: 2.1 time: 0.164668 Aug 30 05:13:43.203261 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 122/263] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:43 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:43.292618 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-48f15f2a-4cb9-4311-a186-8bc06f296275 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:43.293227 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-48f15f2a-4cb9-4311-a186-8bc06f296275 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:43.299970 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48f15f2a-4cb9-4311-a186-8bc06f296275 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:43.300587 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48f15f2a-4cb9-4311-a186-8bc06f296275 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:43.301043 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48f15f2a-4cb9-4311-a186-8bc06f296275 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:43.301751 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48f15f2a-4cb9-4311-a186-8bc06f296275 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:43.302198 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48f15f2a-4cb9-4311-a186-8bc06f296275 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:43.302668 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48f15f2a-4cb9-4311-a186-8bc06f296275 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:43.450591 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-48f15f2a-4cb9-4311-a186-8bc06f296275 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:43.463696 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-48f15f2a-4cb9-4311-a186-8bc06f296275 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.175022 Aug 30 05:13:43.464675 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 142/264] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:43 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:43.779885 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8a072c00-8d9b-4d53-8780-2f0109a0e18d tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:43.781002 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8a072c00-8d9b-4d53-8780-2f0109a0e18d tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:43.788901 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a072c00-8d9b-4d53-8780-2f0109a0e18d tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:43.790922 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a072c00-8d9b-4d53-8780-2f0109a0e18d tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:43.791753 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a072c00-8d9b-4d53-8780-2f0109a0e18d tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:43.792699 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a072c00-8d9b-4d53-8780-2f0109a0e18d tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:43.793205 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a072c00-8d9b-4d53-8780-2f0109a0e18d tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:43.793786 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a072c00-8d9b-4d53-8780-2f0109a0e18d tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:44.019341 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8a072c00-8d9b-4d53-8780-2f0109a0e18d tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:44.029196 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8a072c00-8d9b-4d53-8780-2f0109a0e18d tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1313 microversion: 2.1 time: 0.255899 Aug 30 05:13:44.029783 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 123/265] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:43 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:44.226883 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6313bb09-e58b-4c44-9163-d718510ef6af tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:44.228578 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6313bb09-e58b-4c44-9163-d718510ef6af tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:44.238363 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6313bb09-e58b-4c44-9163-d718510ef6af tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:44.239202 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6313bb09-e58b-4c44-9163-d718510ef6af tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:44.239900 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6313bb09-e58b-4c44-9163-d718510ef6af tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:44.240812 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6313bb09-e58b-4c44-9163-d718510ef6af tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:44.242425 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6313bb09-e58b-4c44-9163-d718510ef6af tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:44.243737 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6313bb09-e58b-4c44-9163-d718510ef6af tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:44.400369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6313bb09-e58b-4c44-9163-d718510ef6af tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:44.408665 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6313bb09-e58b-4c44-9163-d718510ef6af tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1315 microversion: 2.1 time: 0.185325 Aug 30 05:13:44.422048 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 143/266] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:44 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:44.486153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b7b478b5-1d58-4e90-9900-95489168ff45 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:44.486779 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b7b478b5-1d58-4e90-9900-95489168ff45 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:44.494098 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b478b5-1d58-4e90-9900-95489168ff45 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:44.494781 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b478b5-1d58-4e90-9900-95489168ff45 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:44.497404 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b478b5-1d58-4e90-9900-95489168ff45 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:44.498146 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b478b5-1d58-4e90-9900-95489168ff45 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:44.499807 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b478b5-1d58-4e90-9900-95489168ff45 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:44.500623 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b7b478b5-1d58-4e90-9900-95489168ff45 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:44.663760 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b7b478b5-1d58-4e90-9900-95489168ff45 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:44.671389 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b7b478b5-1d58-4e90-9900-95489168ff45 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1522 microversion: 2.1 time: 0.189401 Aug 30 05:13:44.671947 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 124/267] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:44 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:45.049706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4cdb733d-3b83-4350-b733-bb7f6b80032a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:45.050370 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4cdb733d-3b83-4350-b733-bb7f6b80032a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:45.056546 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4cdb733d-3b83-4350-b733-bb7f6b80032a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:45.057128 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4cdb733d-3b83-4350-b733-bb7f6b80032a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:45.057556 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4cdb733d-3b83-4350-b733-bb7f6b80032a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:45.058241 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4cdb733d-3b83-4350-b733-bb7f6b80032a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:45.058685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4cdb733d-3b83-4350-b733-bb7f6b80032a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:45.059151 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4cdb733d-3b83-4350-b733-bb7f6b80032a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:45.187678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4cdb733d-3b83-4350-b733-bb7f6b80032a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:45.196488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4cdb733d-3b83-4350-b733-bb7f6b80032a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1313 microversion: 2.1 time: 0.150460 Aug 30 05:13:45.196991 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 144/268] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:45 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:45.429544 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a0ae4e7d-165e-41be-a178-b6689148327f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:45.430155 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a0ae4e7d-165e-41be-a178-b6689148327f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:45.454354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a0ae4e7d-165e-41be-a178-b6689148327f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:45.455382 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a0ae4e7d-165e-41be-a178-b6689148327f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:45.456578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a0ae4e7d-165e-41be-a178-b6689148327f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:45.457763 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a0ae4e7d-165e-41be-a178-b6689148327f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:45.458357 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a0ae4e7d-165e-41be-a178-b6689148327f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:45.458969 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a0ae4e7d-165e-41be-a178-b6689148327f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:45.670723 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:45.692221 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9d062f25-260f-4f45-84ca-bbf9d98d160f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:45.693065 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9d062f25-260f-4f45-84ca-bbf9d98d160f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:45.694979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:45.695687 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=14 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:45.701257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d062f25-260f-4f45-84ca-bbf9d98d160f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:45.701735 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d062f25-260f-4f45-84ca-bbf9d98d160f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:45.702298 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d062f25-260f-4f45-84ca-bbf9d98d160f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:45.702893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d062f25-260f-4f45-84ca-bbf9d98d160f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:45.703343 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d062f25-260f-4f45-84ca-bbf9d98d160f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:45.703893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d062f25-260f-4f45-84ca-bbf9d98d160f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:45.873105 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a0ae4e7d-165e-41be-a178-b6689148327f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:45.881986 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a0ae4e7d-165e-41be-a178-b6689148327f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1315 microversion: 2.1 time: 0.456157 Aug 30 05:13:45.882582 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 125/269] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:45 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:45.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9d062f25-260f-4f45-84ca-bbf9d98d160f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:45.911628 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9d062f25-260f-4f45-84ca-bbf9d98d160f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1502 microversion: 2.1 time: 0.221130 Aug 30 05:13:45.924999 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 145/270] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:45 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1502 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:45.932101 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-45cb4bf1-f8f8-4aab-b025-d94599acf22b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:45.932954 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-45cb4bf1-f8f8-4aab-b025-d94599acf22b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:45.939656 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45cb4bf1-f8f8-4aab-b025-d94599acf22b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:45.940352 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45cb4bf1-f8f8-4aab-b025-d94599acf22b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:45.940948 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45cb4bf1-f8f8-4aab-b025-d94599acf22b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:45.941804 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45cb4bf1-f8f8-4aab-b025-d94599acf22b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:45.942425 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45cb4bf1-f8f8-4aab-b025-d94599acf22b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:45.943039 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-45cb4bf1-f8f8-4aab-b025-d94599acf22b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:46.218530 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-388810ae-eb64-47c3-92ea-2c94edf295c7 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:46.219194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-388810ae-eb64-47c3-92ea-2c94edf295c7 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:46.227041 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-388810ae-eb64-47c3-92ea-2c94edf295c7 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:46.227796 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-388810ae-eb64-47c3-92ea-2c94edf295c7 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:46.228429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-388810ae-eb64-47c3-92ea-2c94edf295c7 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:46.229467 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-388810ae-eb64-47c3-92ea-2c94edf295c7 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:46.230235 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-388810ae-eb64-47c3-92ea-2c94edf295c7 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:46.230898 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-388810ae-eb64-47c3-92ea-2c94edf295c7 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:46.332714 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-45cb4bf1-f8f8-4aab-b025-d94599acf22b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:46.376023 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-45cb4bf1-f8f8-4aab-b025-d94599acf22b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1516 microversion: 2.1 time: 0.446107 Aug 30 05:13:46.387421 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 126/271] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:45 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1516 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:46.392398 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-887d1bc8-5a82-4e92-bda7-8498dbdeca54 req-c85b9b4c-980f-4631-a4fe-879574a76573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd0e6d54-d23a-4a22-a5ab-9a224a71b460", "name": "network-vif-plugged", "status": "completed", "tag": "ace1ce2c-60f2-4276-97c3-6f26d166aceb"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:46.418769 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-887d1bc8-5a82-4e92-bda7-8498dbdeca54 req-c85b9b4c-980f-4631-a4fe-879574a76573 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:46.419224 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-887d1bc8-5a82-4e92-bda7-8498dbdeca54 req-c85b9b4c-980f-4631-a4fe-879574a76573 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:46.419867 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-887d1bc8-5a82-4e92-bda7-8498dbdeca54 req-c85b9b4c-980f-4631-a4fe-879574a76573 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:46.433387 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-887d1bc8-5a82-4e92-bda7-8498dbdeca54 req-c85b9b4c-980f-4631-a4fe-879574a76573 service nova] Creating event network-vif-plugged:ace1ce2c-60f2-4276-97c3-6f26d166aceb for instance bd0e6d54-d23a-4a22-a5ab-9a224a71b460 on hv-cinder-85391 Aug 30 05:13:46.439392 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-887d1bc8-5a82-4e92-bda7-8498dbdeca54 req-c85b9b4c-980f-4631-a4fe-879574a76573 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050501 Aug 30 05:13:46.440633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 127/272] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:46.596996 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-388810ae-eb64-47c3-92ea-2c94edf295c7 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:46.605060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-388810ae-eb64-47c3-92ea-2c94edf295c7 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1313 microversion: 2.1 time: 0.391111 Aug 30 05:13:46.614675 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 146/273] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:46 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:46.904956 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cf7f0d97-3775-42ed-bd9a-3276a6fa9c52 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:46.906366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cf7f0d97-3775-42ed-bd9a-3276a6fa9c52 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:46.928611 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf7f0d97-3775-42ed-bd9a-3276a6fa9c52 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:46.944896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf7f0d97-3775-42ed-bd9a-3276a6fa9c52 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:46.944896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf7f0d97-3775-42ed-bd9a-3276a6fa9c52 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:46.944896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf7f0d97-3775-42ed-bd9a-3276a6fa9c52 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:46.944896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf7f0d97-3775-42ed-bd9a-3276a6fa9c52 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:46.945217 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf7f0d97-3775-42ed-bd9a-3276a6fa9c52 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:47.197491 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cf7f0d97-3775-42ed-bd9a-3276a6fa9c52 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:47.206174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cf7f0d97-3775-42ed-bd9a-3276a6fa9c52 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1315 microversion: 2.1 time: 0.305878 Aug 30 05:13:47.207221 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 128/274] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:46 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:47.635799 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-31043369-0741-469f-8226-ca395b28ee1c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:47.636417 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-31043369-0741-469f-8226-ca395b28ee1c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:47.638762 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:47.644537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31043369-0741-469f-8226-ca395b28ee1c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:47.645025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31043369-0741-469f-8226-ca395b28ee1c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:47.645461 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31043369-0741-469f-8226-ca395b28ee1c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:47.646160 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31043369-0741-469f-8226-ca395b28ee1c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:47.646615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31043369-0741-469f-8226-ca395b28ee1c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:47.647073 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-31043369-0741-469f-8226-ca395b28ee1c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:47.984615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-31043369-0741-469f-8226-ca395b28ee1c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:47.994074 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-31043369-0741-469f-8226-ca395b28ee1c tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1313 microversion: 2.1 time: 0.361976 Aug 30 05:13:47.995297 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 147/275] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:47 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:48.084719 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b03fa8d6-da1e-40ff-b6d3-8d1c8ee9dce8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:48.086921 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b03fa8d6-da1e-40ff-b6d3-8d1c8ee9dce8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:48.093433 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b03fa8d6-da1e-40ff-b6d3-8d1c8ee9dce8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:48.094177 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b03fa8d6-da1e-40ff-b6d3-8d1c8ee9dce8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:48.094647 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b03fa8d6-da1e-40ff-b6d3-8d1c8ee9dce8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:48.096254 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b03fa8d6-da1e-40ff-b6d3-8d1c8ee9dce8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:48.096715 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b03fa8d6-da1e-40ff-b6d3-8d1c8ee9dce8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:48.097145 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b03fa8d6-da1e-40ff-b6d3-8d1c8ee9dce8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:48.131242 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-b03fa8d6-da1e-40ff-b6d3-8d1c8ee9dce8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lazy-loading 'flavor' on Instance uuid e0ec17dd-c9e2-4802-86c7-f985a04be891 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:13:48.230045 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e5884d42-87c0-4945-8a25-d7ca5825d87a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:48.230915 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e5884d42-87c0-4945-8a25-d7ca5825d87a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:48.239375 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e5884d42-87c0-4945-8a25-d7ca5825d87a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:48.239979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e5884d42-87c0-4945-8a25-d7ca5825d87a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:48.240726 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e5884d42-87c0-4945-8a25-d7ca5825d87a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:48.241958 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e5884d42-87c0-4945-8a25-d7ca5825d87a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:48.242917 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e5884d42-87c0-4945-8a25-d7ca5825d87a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:48.245024 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e5884d42-87c0-4945-8a25-d7ca5825d87a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:48.438846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b03fa8d6-da1e-40ff-b6d3-8d1c8ee9dce8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "POST /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891/action" status: 200 len: 32 microversion: 2.1 time: 0.359003 Aug 30 05:13:48.439694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 129/276] 10.222.0.77 () {60 vars in 1278 bytes} [Tue Aug 30 05:13:48 2022] POST /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891/action => generated 32 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 05:13:48.450436 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5111440f-d472-479d-a8d5-212e15e5b3cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:48.451204 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5111440f-d472-479d-a8d5-212e15e5b3cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:48.451697 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e5884d42-87c0-4945-8a25-d7ca5825d87a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:48.458663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5111440f-d472-479d-a8d5-212e15e5b3cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:48.462254 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5111440f-d472-479d-a8d5-212e15e5b3cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:48.463101 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5111440f-d472-479d-a8d5-212e15e5b3cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:48.463990 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e5884d42-87c0-4945-8a25-d7ca5825d87a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1464 microversion: 2.1 time: 0.239130 Aug 30 05:13:48.464140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5111440f-d472-479d-a8d5-212e15e5b3cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:48.464528 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5111440f-d472-479d-a8d5-212e15e5b3cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:48.465024 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5111440f-d472-479d-a8d5-212e15e5b3cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:48.467838 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 148/277] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:48 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1464 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:48.518840 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-762b0ed0-bec7-4c77-9e6d-f93720f466e5 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:48.519877 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-762b0ed0-bec7-4c77-9e6d-f93720f466e5 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:48.526262 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-762b0ed0-bec7-4c77-9e6d-f93720f466e5 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:48.526757 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-762b0ed0-bec7-4c77-9e6d-f93720f466e5 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:48.527257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-762b0ed0-bec7-4c77-9e6d-f93720f466e5 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:48.528143 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-762b0ed0-bec7-4c77-9e6d-f93720f466e5 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:48.528607 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-762b0ed0-bec7-4c77-9e6d-f93720f466e5 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:48.529036 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-762b0ed0-bec7-4c77-9e6d-f93720f466e5 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:48.564543 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-762b0ed0-bec7-4c77-9e6d-f93720f466e5 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:13:48.678425 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5111440f-d472-479d-a8d5-212e15e5b3cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:48.686519 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5111440f-d472-479d-a8d5-212e15e5b3cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.240873 Aug 30 05:13:48.688008 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 130/278] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:48 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:48.693139 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-752d46d2-af89-4e2a-8752-76528ccc1fe4 req-1963787a-bec0-4a67-b31a-ba87977ce263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "792da216-65d1-4514-8eca-250051397974", "name": "network-vif-plugged", "status": "completed", "tag": "38cd1a99-b826-46f6-973e-bf6c13f95335"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:48.704171 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-752d46d2-af89-4e2a-8752-76528ccc1fe4 req-1963787a-bec0-4a67-b31a-ba87977ce263 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:48.705330 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-752d46d2-af89-4e2a-8752-76528ccc1fe4 req-1963787a-bec0-4a67-b31a-ba87977ce263 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:48.705924 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-752d46d2-af89-4e2a-8752-76528ccc1fe4 req-1963787a-bec0-4a67-b31a-ba87977ce263 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:48.721260 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-752d46d2-af89-4e2a-8752-76528ccc1fe4 req-1963787a-bec0-4a67-b31a-ba87977ce263 service nova] Creating event network-vif-plugged:38cd1a99-b826-46f6-973e-bf6c13f95335 for instance 792da216-65d1-4514-8eca-250051397974 on hv-cinder-85391 Aug 30 05:13:48.742549 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-752d46d2-af89-4e2a-8752-76528ccc1fe4 req-1963787a-bec0-4a67-b31a-ba87977ce263 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039444 Aug 30 05:13:48.742549 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 131/279] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:48.775107 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-762b0ed0-bec7-4c77-9e6d-f93720f466e5 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "DELETE /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 204 len: 0 microversion: 2.1 time: 0.259993 Aug 30 05:13:48.776708 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 149/280] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:13:48 2022] DELETE /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 05:13:48.791586 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-07fb433c-32ef-4a93-b8af-c85a2d6bae8a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:48.792402 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-07fb433c-32ef-4a93-b8af-c85a2d6bae8a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:48.806129 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07fb433c-32ef-4a93-b8af-c85a2d6bae8a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:48.806847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07fb433c-32ef-4a93-b8af-c85a2d6bae8a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:48.807477 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07fb433c-32ef-4a93-b8af-c85a2d6bae8a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:48.808209 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07fb433c-32ef-4a93-b8af-c85a2d6bae8a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:48.808679 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07fb433c-32ef-4a93-b8af-c85a2d6bae8a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:48.809161 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07fb433c-32ef-4a93-b8af-c85a2d6bae8a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:48.907364 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2126745431", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452", "networks": [{"uuid": "fc212efd-2a77-4199-8dbb-eb28c0903801"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:48.963031 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-07fb433c-32ef-4a93-b8af-c85a2d6bae8a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:48.984383 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-07fb433c-32ef-4a93-b8af-c85a2d6bae8a tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1470 microversion: 2.1 time: 0.202969 Aug 30 05:13:48.986601 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 132/281] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:48 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:48.987085 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] validate_networks() for [('fc212efd-2a77-4199-8dbb-eb28c0903801', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:13:49.018375 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3b07f548-5f73-4d16-ad7f-e0382899ed41 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:49.020224 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3b07f548-5f73-4d16-ad7f-e0382899ed41 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:49.028532 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b07f548-5f73-4d16-ad7f-e0382899ed41 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:49.029038 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b07f548-5f73-4d16-ad7f-e0382899ed41 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:49.029481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b07f548-5f73-4d16-ad7f-e0382899ed41 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:49.030207 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b07f548-5f73-4d16-ad7f-e0382899ed41 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:49.030667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b07f548-5f73-4d16-ad7f-e0382899ed41 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:49.031404 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3b07f548-5f73-4d16-ad7f-e0382899ed41 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:49.036825 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:49.215292 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3b07f548-5f73-4d16-ad7f-e0382899ed41 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:49.224355 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3b07f548-5f73-4d16-ad7f-e0382899ed41 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1313 microversion: 2.1 time: 0.212337 Aug 30 05:13:49.225319 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 133/282] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:49 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:49.417982 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:13:49.418400 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:13:49.418899 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:13:49.419306 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:13:49.419711 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:13:49.429003 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:49.429472 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:49.429895 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:49.430603 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:49.431074 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:49.431490 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:49.450047 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Getting quotas for project d98f56be5fb14ebe9e938ebc0f642994. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:13:49.454216 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Getting quotas for user 7522bcceac404e8aa10f719507fe1436 and project d98f56be5fb14ebe9e938ebc0f642994. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:13:49.466197 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:13:49.469004 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:13:49.516458 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-92f4f762-ef2d-4781-a3fa-9a7c3b862abf tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615674 Aug 30 05:13:49.517479 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 150/283] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:13:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 05:13:49.527560 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-40ee100f-8e1f-4a3d-a8e0-b06e6e6ab5a1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:49.528358 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-40ee100f-8e1f-4a3d-a8e0-b06e6e6ab5a1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:49.587373 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-40ee100f-8e1f-4a3d-a8e0-b06e6e6ab5a1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:49.595815 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-40ee100f-8e1f-4a3d-a8e0-b06e6e6ab5a1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1219 microversion: 2.1 time: 0.071369 Aug 30 05:13:49.596388 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 134/284] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:49 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:49.709106 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e98edad4-842f-47f0-9f7b-f60f1618e659 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:49.709907 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e98edad4-842f-47f0-9f7b-f60f1618e659 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:49.716633 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e98edad4-842f-47f0-9f7b-f60f1618e659 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:49.717352 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e98edad4-842f-47f0-9f7b-f60f1618e659 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:49.717946 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e98edad4-842f-47f0-9f7b-f60f1618e659 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:49.719337 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e98edad4-842f-47f0-9f7b-f60f1618e659 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:49.719946 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e98edad4-842f-47f0-9f7b-f60f1618e659 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:49.721044 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e98edad4-842f-47f0-9f7b-f60f1618e659 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:49.727562 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:49.919061 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e98edad4-842f-47f0-9f7b-f60f1618e659 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:49.927701 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e98edad4-842f-47f0-9f7b-f60f1618e659 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.223045 Aug 30 05:13:49.929035 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 151/285] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:49 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:50.008078 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b9674948-dd33-424f-bf98-4db5a6074952 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:50.008768 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b9674948-dd33-424f-bf98-4db5a6074952 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:50.017657 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b9674948-dd33-424f-bf98-4db5a6074952 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:50.018249 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b9674948-dd33-424f-bf98-4db5a6074952 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:50.018759 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b9674948-dd33-424f-bf98-4db5a6074952 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:50.019603 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b9674948-dd33-424f-bf98-4db5a6074952 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:50.020429 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b9674948-dd33-424f-bf98-4db5a6074952 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:50.020862 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b9674948-dd33-424f-bf98-4db5a6074952 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:50.245696 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-03ce1586-6e20-43e9-afaf-ae322deb5c81 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:50.246420 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-03ce1586-6e20-43e9-afaf-ae322deb5c81 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:50.252914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03ce1586-6e20-43e9-afaf-ae322deb5c81 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:50.253493 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03ce1586-6e20-43e9-afaf-ae322deb5c81 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:50.253988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03ce1586-6e20-43e9-afaf-ae322deb5c81 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:50.254754 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03ce1586-6e20-43e9-afaf-ae322deb5c81 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:50.255484 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03ce1586-6e20-43e9-afaf-ae322deb5c81 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:50.256013 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03ce1586-6e20-43e9-afaf-ae322deb5c81 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:50.295628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b9674948-dd33-424f-bf98-4db5a6074952 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:50.305215 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b9674948-dd33-424f-bf98-4db5a6074952 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1470 microversion: 2.1 time: 0.303272 Aug 30 05:13:50.306535 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 135/286] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:50 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1470 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:50.469387 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-03ce1586-6e20-43e9-afaf-ae322deb5c81 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:50.482432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-03ce1586-6e20-43e9-afaf-ae322deb5c81 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1313 microversion: 2.1 time: 0.240558 Aug 30 05:13:50.498122 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 152/287] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:50 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:50.616899 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-99171742-915a-4bec-ad0d-00081fe10fd5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:50.617631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-99171742-915a-4bec-ad0d-00081fe10fd5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:50.626003 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99171742-915a-4bec-ad0d-00081fe10fd5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:50.627184 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99171742-915a-4bec-ad0d-00081fe10fd5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:50.627629 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99171742-915a-4bec-ad0d-00081fe10fd5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:50.628734 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99171742-915a-4bec-ad0d-00081fe10fd5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:50.629348 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99171742-915a-4bec-ad0d-00081fe10fd5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:50.629781 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99171742-915a-4bec-ad0d-00081fe10fd5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:50.702791 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-99171742-915a-4bec-ad0d-00081fe10fd5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:50.711574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-99171742-915a-4bec-ad0d-00081fe10fd5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1271 microversion: 2.1 time: 0.097720 Aug 30 05:13:50.725005 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 136/288] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:50 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:50.948729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ad4fbb68-2553-430e-a1ad-6c69379ac136 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:50.949330 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ad4fbb68-2553-430e-a1ad-6c69379ac136 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:50.964593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad4fbb68-2553-430e-a1ad-6c69379ac136 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:50.965287 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad4fbb68-2553-430e-a1ad-6c69379ac136 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:50.966432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad4fbb68-2553-430e-a1ad-6c69379ac136 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:50.967369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad4fbb68-2553-430e-a1ad-6c69379ac136 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:50.967834 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad4fbb68-2553-430e-a1ad-6c69379ac136 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:50.968260 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad4fbb68-2553-430e-a1ad-6c69379ac136 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:51.122033 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-fa459097-f4bc-4f06-b311-0612f95371bd req-f98be6d0-66c5-4026-8503-dcc083248f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd0e6d54-d23a-4a22-a5ab-9a224a71b460", "name": "network-vif-deleted", "tag": "ace1ce2c-60f2-4276-97c3-6f26d166aceb"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:51.137268 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-fa459097-f4bc-4f06-b311-0612f95371bd req-f98be6d0-66c5-4026-8503-dcc083248f9d service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:51.137773 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-fa459097-f4bc-4f06-b311-0612f95371bd req-f98be6d0-66c5-4026-8503-dcc083248f9d service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:51.138165 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-fa459097-f4bc-4f06-b311-0612f95371bd req-f98be6d0-66c5-4026-8503-dcc083248f9d service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:51.139325 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ad4fbb68-2553-430e-a1ad-6c69379ac136 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:51.150271 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-fa459097-f4bc-4f06-b311-0612f95371bd req-f98be6d0-66c5-4026-8503-dcc083248f9d service nova] Creating event network-vif-deleted:ace1ce2c-60f2-4276-97c3-6f26d166aceb for instance bd0e6d54-d23a-4a22-a5ab-9a224a71b460 on hv-cinder-85391 Aug 30 05:13:51.150650 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ad4fbb68-2553-430e-a1ad-6c69379ac136 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.205585 Aug 30 05:13:51.151611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 153/289] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:50 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:51.165608 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-fa459097-f4bc-4f06-b311-0612f95371bd req-f98be6d0-66c5-4026-8503-dcc083248f9d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047374 Aug 30 05:13:51.166405 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 137/290] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:13:51.327892 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-06505575-c55b-41d9-838f-b1d9880a343d tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:51.328485 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-06505575-c55b-41d9-838f-b1d9880a343d tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:51.335070 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06505575-c55b-41d9-838f-b1d9880a343d tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:51.335555 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06505575-c55b-41d9-838f-b1d9880a343d tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:51.336084 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06505575-c55b-41d9-838f-b1d9880a343d tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:51.336785 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06505575-c55b-41d9-838f-b1d9880a343d tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:51.337240 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06505575-c55b-41d9-838f-b1d9880a343d tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:51.337666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06505575-c55b-41d9-838f-b1d9880a343d tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:51.400504 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-06505575-c55b-41d9-838f-b1d9880a343d tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:51.409216 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-06505575-c55b-41d9-838f-b1d9880a343d tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1300 microversion: 2.1 time: 0.085201 Aug 30 05:13:51.409847 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 154/291] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:51 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:51.505383 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-72b93fa1-beff-4048-82e5-a1a314c953ec tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:51.506080 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-72b93fa1-beff-4048-82e5-a1a314c953ec tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:51.512141 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72b93fa1-beff-4048-82e5-a1a314c953ec tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:51.512623 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72b93fa1-beff-4048-82e5-a1a314c953ec tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:51.513057 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72b93fa1-beff-4048-82e5-a1a314c953ec tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:51.513740 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72b93fa1-beff-4048-82e5-a1a314c953ec tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:51.514191 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72b93fa1-beff-4048-82e5-a1a314c953ec tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:51.514612 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72b93fa1-beff-4048-82e5-a1a314c953ec tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:51.686536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-72b93fa1-beff-4048-82e5-a1a314c953ec tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:51.696213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-72b93fa1-beff-4048-82e5-a1a314c953ec tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1313 microversion: 2.1 time: 0.195385 Aug 30 05:13:51.697322 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 138/292] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:51 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:51.733656 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d16cd9c2-38b0-4dad-8d59-b7dbb643727d tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:51.735758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d16cd9c2-38b0-4dad-8d59-b7dbb643727d tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:51.746286 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d16cd9c2-38b0-4dad-8d59-b7dbb643727d tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:51.746944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d16cd9c2-38b0-4dad-8d59-b7dbb643727d tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:51.747477 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d16cd9c2-38b0-4dad-8d59-b7dbb643727d tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:51.748320 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d16cd9c2-38b0-4dad-8d59-b7dbb643727d tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:51.748890 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d16cd9c2-38b0-4dad-8d59-b7dbb643727d tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:51.749413 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d16cd9c2-38b0-4dad-8d59-b7dbb643727d tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:51.830840 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d16cd9c2-38b0-4dad-8d59-b7dbb643727d tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:51.849910 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d16cd9c2-38b0-4dad-8d59-b7dbb643727d tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1279 microversion: 2.1 time: 0.121475 Aug 30 05:13:51.850484 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 155/293] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:51 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1279 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:52.174769 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2a63f3cf-85e2-4f40-8222-bcffb917d64e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:52.175212 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2a63f3cf-85e2-4f40-8222-bcffb917d64e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:52.182065 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a63f3cf-85e2-4f40-8222-bcffb917d64e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.182485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a63f3cf-85e2-4f40-8222-bcffb917d64e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.182948 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a63f3cf-85e2-4f40-8222-bcffb917d64e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:52.183661 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a63f3cf-85e2-4f40-8222-bcffb917d64e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.184128 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a63f3cf-85e2-4f40-8222-bcffb917d64e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.184573 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a63f3cf-85e2-4f40-8222-bcffb917d64e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:52.398848 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2a63f3cf-85e2-4f40-8222-bcffb917d64e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:52.406628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2a63f3cf-85e2-4f40-8222-bcffb917d64e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.237121 Aug 30 05:13:52.407298 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 139/294] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:52 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:52.430068 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8c30fd8f-1808-4ed5-bf94-486b7c3f472f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:52.431405 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8c30fd8f-1808-4ed5-bf94-486b7c3f472f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:52.437229 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c30fd8f-1808-4ed5-bf94-486b7c3f472f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.437653 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c30fd8f-1808-4ed5-bf94-486b7c3f472f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.438083 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c30fd8f-1808-4ed5-bf94-486b7c3f472f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:52.438796 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c30fd8f-1808-4ed5-bf94-486b7c3f472f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.439301 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c30fd8f-1808-4ed5-bf94-486b7c3f472f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.439739 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c30fd8f-1808-4ed5-bf94-486b7c3f472f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:52.475102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c30fd8f-1808-4ed5-bf94-486b7c3f472f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.475823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c30fd8f-1808-4ed5-bf94-486b7c3f472f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.476433 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8c30fd8f-1808-4ed5-bf94-486b7c3f472f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:52.477522 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-8c30fd8f-1808-4ed5-bf94-486b7c3f472f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lazy-loading 'fault' on Instance uuid bd0e6d54-d23a-4a22-a5ab-9a224a71b460 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:13:52.529601 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8c30fd8f-1808-4ed5-bf94-486b7c3f472f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71e9c605498544c8b6c75349d9b66a94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ba05d601a9240bb922f4d6dc3cc6bc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:52.537624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8c30fd8f-1808-4ed5-bf94-486b7c3f472f tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 200 len: 1305 microversion: 2.1 time: 0.111493 Aug 30 05:13:52.538178 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 156/295] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:52 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 1305 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:52.722775 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-878c808d-d142-4a21-8c2a-42f3233d6a26 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:52.722775 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-878c808d-d142-4a21-8c2a-42f3233d6a26 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:52.724245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=88 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:52.729355 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-878c808d-d142-4a21-8c2a-42f3233d6a26 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.731707 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-878c808d-d142-4a21-8c2a-42f3233d6a26 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.731707 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-878c808d-d142-4a21-8c2a-42f3233d6a26 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:52.731707 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-878c808d-d142-4a21-8c2a-42f3233d6a26 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.731707 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-878c808d-d142-4a21-8c2a-42f3233d6a26 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.732088 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-878c808d-d142-4a21-8c2a-42f3233d6a26 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:52.871674 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-051309d5-9ce4-4e6b-9a06-9abdb9ac6952 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:52.872288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-051309d5-9ce4-4e6b-9a06-9abdb9ac6952 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:52.878365 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-051309d5-9ce4-4e6b-9a06-9abdb9ac6952 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.879304 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-051309d5-9ce4-4e6b-9a06-9abdb9ac6952 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.879909 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-051309d5-9ce4-4e6b-9a06-9abdb9ac6952 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:52.880781 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-051309d5-9ce4-4e6b-9a06-9abdb9ac6952 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.881382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-051309d5-9ce4-4e6b-9a06-9abdb9ac6952 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.881950 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-051309d5-9ce4-4e6b-9a06-9abdb9ac6952 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:53.026990 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-051309d5-9ce4-4e6b-9a06-9abdb9ac6952 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:53.034853 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-051309d5-9ce4-4e6b-9a06-9abdb9ac6952 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1319 microversion: 2.1 time: 0.166898 Aug 30 05:13:53.035915 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 157/296] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:52 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:53.227139 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-878c808d-d142-4a21-8c2a-42f3233d6a26 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:53.236559 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-878c808d-d142-4a21-8c2a-42f3233d6a26 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1497 microversion: 2.1 time: 0.520385 Aug 30 05:13:53.245571 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 140/297] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:52 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1497 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:53.429386 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a71406b5-0c65-49a8-b930-edcb7f07bbfc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:53.430159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a71406b5-0c65-49a8-b930-edcb7f07bbfc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:53.436456 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a71406b5-0c65-49a8-b930-edcb7f07bbfc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:53.437019 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a71406b5-0c65-49a8-b930-edcb7f07bbfc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:53.437646 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a71406b5-0c65-49a8-b930-edcb7f07bbfc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:53.438394 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a71406b5-0c65-49a8-b930-edcb7f07bbfc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:53.439558 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a71406b5-0c65-49a8-b930-edcb7f07bbfc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:53.440132 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a71406b5-0c65-49a8-b930-edcb7f07bbfc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:53.503301 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-c00c3d0e-048f-4daf-b9c9-88094f35ad27 req-28af7e58-5dad-406c-ab30-c9cdece9f8aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48af496a-2b9e-4b18-aad8-59e43cfa075b", "tag": "b0c9e9dd-7bc1-4662-8798-666b8b9584c8"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:53.520360 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c00c3d0e-048f-4daf-b9c9-88094f35ad27 req-28af7e58-5dad-406c-ab30-c9cdece9f8aa service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:53.521106 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c00c3d0e-048f-4daf-b9c9-88094f35ad27 req-28af7e58-5dad-406c-ab30-c9cdece9f8aa service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:53.521773 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c00c3d0e-048f-4daf-b9c9-88094f35ad27 req-28af7e58-5dad-406c-ab30-c9cdece9f8aa service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:53.567576 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-c00c3d0e-048f-4daf-b9c9-88094f35ad27 req-28af7e58-5dad-406c-ab30-c9cdece9f8aa service nova] Creating event network-changed:b0c9e9dd-7bc1-4662-8798-666b8b9584c8 for instance 48af496a-2b9e-4b18-aad8-59e43cfa075b on hv-cinder-85391 Aug 30 05:13:53.576696 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-c00c3d0e-048f-4daf-b9c9-88094f35ad27 req-28af7e58-5dad-406c-ab30-c9cdece9f8aa service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076099 Aug 30 05:13:53.578797 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 141/298] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:53.591417 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-70dbb7b8-6749-4233-a0d9-f2e87dea0dc9 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:53.592214 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-70dbb7b8-6749-4233-a0d9-f2e87dea0dc9 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] [instance: bd0e6d54-d23a-4a22-a5ab-9a224a71b460] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:53.602955 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a71406b5-0c65-49a8-b930-edcb7f07bbfc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:53.603578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70dbb7b8-6749-4233-a0d9-f2e87dea0dc9 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:53.604146 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70dbb7b8-6749-4233-a0d9-f2e87dea0dc9 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:53.604645 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70dbb7b8-6749-4233-a0d9-f2e87dea0dc9 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:53.605738 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70dbb7b8-6749-4233-a0d9-f2e87dea0dc9 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:53.606747 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70dbb7b8-6749-4233-a0d9-f2e87dea0dc9 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:53.607413 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-70dbb7b8-6749-4233-a0d9-f2e87dea0dc9 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:53.614250 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a71406b5-0c65-49a8-b930-edcb7f07bbfc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.189042 Aug 30 05:13:53.629133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 158/299] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:53 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:53.639397 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-70dbb7b8-6749-4233-a0d9-f2e87dea0dc9 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] HTTP exception thrown: Instance bd0e6d54-d23a-4a22-a5ab-9a224a71b460 could not be found. Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-70dbb7b8-6749-4233-a0d9-f2e87dea0dc9 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Request method failure captured: Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 HTTP/1.1 Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZx4ofgQBJRH6sr6dKZEQfHFv6JvFBcFmARVd9lb7VVFwuR3Ez2xXzJeB5SPTNxwkVKteXQjTTa9u22ophKM94M2hvCWPy07Lr0M3PhEA4K0VTkyiPKBWmfY2niS0-vfFs3rWDghyUFcWeUF-HJhD4L-jYLcVObHXm190HZFsBULSvc Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: 5ba05d601a9240bb922f4d6dc3cc6bc6 Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesNegativeTest-608150310 Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:13:53.644516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:13:53.646047 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/5ba05d601a9240bb922f4d6dc3cc6bc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/5ba05d601a9240bb922f4d6dc3cc6bc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/5ba05d601a9240bb922f4d6dc3cc6bc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_5ba05d601a9240bb922f4d6dc3cc6bc6", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:13:53.646047 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesNegativeTest-608150310 Aug 30 05:13:53.646047 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 5ba05d601a9240bb922f4d6dc3cc6bc6 Aug 30 05:13:53.646047 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesNegativeTest-608150310 Aug 30 05:13:53.646047 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesNegativeTest-608150310-project Aug 30 05:13:53.646047 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:13:53.646047 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:13:53.646047 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: 71e9c605498544c8b6c75349d9b66a94 Aug 30 05:13:53.646047 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesNegativeTest-608150310-project Aug 30 05:13:53.646047 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:13:53.646047 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance bd0e6d54-d23a-4a22-a5ab-9a224a71b460 could not be found. Aug 30 05:13:53.646047 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': 'bd0e6d54-d23a-4a22-a5ab-9a224a71b460'} Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd0e6d54-d23a-4a22-a5ab-9a224a71b460 could not be found. Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:13:53.647060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd0e6d54-d23a-4a22-a5ab-9a224a71b460 could not be found. Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd0e6d54-d23a-4a22-a5ab-9a224a71b460 could not be found. Aug 30 05:13:53.650229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:13:53.651683 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-70dbb7b8-6749-4233-a0d9-f2e87dea0dc9 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] Returning 404 to user: Instance bd0e6d54-d23a-4a22-a5ab-9a224a71b460 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:13:53.651683 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-70dbb7b8-6749-4233-a0d9-f2e87dea0dc9 tempest-VolumesNegativeTest-608150310 tempest-VolumesNegativeTest-608150310-project] 10.222.0.77 "GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460" status: 404 len: 111 microversion: 2.1 time: 0.064693 Aug 30 05:13:53.651683 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 142/300] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:53 2022] GET /compute/v2.1/servers/bd0e6d54-d23a-4a22-a5ab-9a224a71b460 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:13:53.844009 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-278f1fa7-57be-4236-8d43-56af6e975571 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:53.844507 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-278f1fa7-57be-4236-8d43-56af6e975571 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:53.850936 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-278f1fa7-57be-4236-8d43-56af6e975571 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:53.851428 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-278f1fa7-57be-4236-8d43-56af6e975571 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:53.851863 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-278f1fa7-57be-4236-8d43-56af6e975571 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:53.852750 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-278f1fa7-57be-4236-8d43-56af6e975571 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:53.853210 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-278f1fa7-57be-4236-8d43-56af6e975571 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:53.853638 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-278f1fa7-57be-4236-8d43-56af6e975571 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:53.880552 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-278f1fa7-57be-4236-8d43-56af6e975571 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:13:53.996037 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-278f1fa7-57be-4236-8d43-56af6e975571 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "DELETE /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 204 len: 0 microversion: 2.1 time: 0.155814 Aug 30 05:13:53.997122 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 159/301] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:13:53 2022] DELETE /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 05:13:54.005706 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-21bd34b9-d916-4bf4-8a36-92ca958fb6f0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:54.006553 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-21bd34b9-d916-4bf4-8a36-92ca958fb6f0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:54.013272 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21bd34b9-d916-4bf4-8a36-92ca958fb6f0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:54.013911 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21bd34b9-d916-4bf4-8a36-92ca958fb6f0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:54.014478 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21bd34b9-d916-4bf4-8a36-92ca958fb6f0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:54.015306 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21bd34b9-d916-4bf4-8a36-92ca958fb6f0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:54.015876 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21bd34b9-d916-4bf4-8a36-92ca958fb6f0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:54.016423 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21bd34b9-d916-4bf4-8a36-92ca958fb6f0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:54.057892 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5d76843e-ae3a-46a0-a186-a3954f099aa5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:54.058905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5d76843e-ae3a-46a0-a186-a3954f099aa5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:54.065471 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d76843e-ae3a-46a0-a186-a3954f099aa5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:54.066181 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d76843e-ae3a-46a0-a186-a3954f099aa5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:54.066944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d76843e-ae3a-46a0-a186-a3954f099aa5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:54.067897 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d76843e-ae3a-46a0-a186-a3954f099aa5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:54.068506 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d76843e-ae3a-46a0-a186-a3954f099aa5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:54.069086 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5d76843e-ae3a-46a0-a186-a3954f099aa5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:54.178909 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-21bd34b9-d916-4bf4-8a36-92ca958fb6f0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:54.189329 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-21bd34b9-d916-4bf4-8a36-92ca958fb6f0 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1503 microversion: 2.1 time: 0.187537 Aug 30 05:13:54.190284 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 143/302] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:54 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:54.374753 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5d76843e-ae3a-46a0-a186-a3954f099aa5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:54.382607 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5d76843e-ae3a-46a0-a186-a3954f099aa5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1319 microversion: 2.1 time: 0.329983 Aug 30 05:13:54.383199 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 160/303] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:54 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:54.636683 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b8acaa9e-7dcb-4fc8-a4cf-f66a058b71b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:54.637308 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b8acaa9e-7dcb-4fc8-a4cf-f66a058b71b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:54.644473 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8acaa9e-7dcb-4fc8-a4cf-f66a058b71b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:54.644954 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8acaa9e-7dcb-4fc8-a4cf-f66a058b71b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:54.645393 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8acaa9e-7dcb-4fc8-a4cf-f66a058b71b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:54.646335 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8acaa9e-7dcb-4fc8-a4cf-f66a058b71b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:54.647017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8acaa9e-7dcb-4fc8-a4cf-f66a058b71b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:54.647459 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b8acaa9e-7dcb-4fc8-a4cf-f66a058b71b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:54.789252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b8acaa9e-7dcb-4fc8-a4cf-f66a058b71b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:54.797438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b8acaa9e-7dcb-4fc8-a4cf-f66a058b71b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.164665 Aug 30 05:13:54.798022 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 144/304] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:54 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:55.210241 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a9bd10dd-2fdb-4eb7-8464-63f749ad3d4a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:55.211031 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a9bd10dd-2fdb-4eb7-8464-63f749ad3d4a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:55.217991 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9bd10dd-2fdb-4eb7-8464-63f749ad3d4a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:55.218803 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9bd10dd-2fdb-4eb7-8464-63f749ad3d4a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:55.219373 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9bd10dd-2fdb-4eb7-8464-63f749ad3d4a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:55.220820 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9bd10dd-2fdb-4eb7-8464-63f749ad3d4a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:55.221401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9bd10dd-2fdb-4eb7-8464-63f749ad3d4a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:55.222031 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9bd10dd-2fdb-4eb7-8464-63f749ad3d4a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:55.355397 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a9bd10dd-2fdb-4eb7-8464-63f749ad3d4a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:55.364257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a9bd10dd-2fdb-4eb7-8464-63f749ad3d4a tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1503 microversion: 2.1 time: 0.157693 Aug 30 05:13:55.364852 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 161/305] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:55 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:55.402593 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ae557c1c-85bc-44b7-ac7a-41411cd78855 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:55.403222 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ae557c1c-85bc-44b7-ac7a-41411cd78855 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:55.409857 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae557c1c-85bc-44b7-ac7a-41411cd78855 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:55.410348 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae557c1c-85bc-44b7-ac7a-41411cd78855 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:55.410776 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae557c1c-85bc-44b7-ac7a-41411cd78855 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:55.411489 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae557c1c-85bc-44b7-ac7a-41411cd78855 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:55.411944 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae557c1c-85bc-44b7-ac7a-41411cd78855 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:55.412362 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae557c1c-85bc-44b7-ac7a-41411cd78855 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:55.551977 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ae557c1c-85bc-44b7-ac7a-41411cd78855 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:55.560305 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ae557c1c-85bc-44b7-ac7a-41411cd78855 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1319 microversion: 2.1 time: 0.161296 Aug 30 05:13:55.560974 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 145/306] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:55 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:55.817790 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-06e7b837-4f97-45f9-9c96-ad3588f927cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:55.818436 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-06e7b837-4f97-45f9-9c96-ad3588f927cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:55.824607 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e7b837-4f97-45f9-9c96-ad3588f927cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:55.825091 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e7b837-4f97-45f9-9c96-ad3588f927cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:55.825527 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e7b837-4f97-45f9-9c96-ad3588f927cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:55.826215 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e7b837-4f97-45f9-9c96-ad3588f927cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:55.826666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e7b837-4f97-45f9-9c96-ad3588f927cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:55.827229 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-06e7b837-4f97-45f9-9c96-ad3588f927cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:55.959843 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-06e7b837-4f97-45f9-9c96-ad3588f927cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:55.967830 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-06e7b837-4f97-45f9-9c96-ad3588f927cf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.153821 Aug 30 05:13:55.968504 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 162/307] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:55 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:56.243102 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ae6ec0c3-1932-4a90-a758-6469a3e5f3e9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:56.243628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ae6ec0c3-1932-4a90-a758-6469a3e5f3e9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:56.249652 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae6ec0c3-1932-4a90-a758-6469a3e5f3e9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:56.250133 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae6ec0c3-1932-4a90-a758-6469a3e5f3e9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:56.250561 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae6ec0c3-1932-4a90-a758-6469a3e5f3e9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:56.251771 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae6ec0c3-1932-4a90-a758-6469a3e5f3e9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:56.252220 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae6ec0c3-1932-4a90-a758-6469a3e5f3e9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:56.252637 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae6ec0c3-1932-4a90-a758-6469a3e5f3e9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:56.282347 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ae6ec0c3-1932-4a90-a758-6469a3e5f3e9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/ips" status: 200 len: 146 microversion: 2.1 time: 0.043473 Aug 30 05:13:56.282999 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 146/308] 10.222.0.77 () {58 vars in 1248 bytes} [Tue Aug 30 05:13:56 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:56.393357 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-98f6c2eb-ae96-4378-95dd-5283eff55ade tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:56.393976 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-98f6c2eb-ae96-4378-95dd-5283eff55ade tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:56.400631 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98f6c2eb-ae96-4378-95dd-5283eff55ade tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:56.401138 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98f6c2eb-ae96-4378-95dd-5283eff55ade tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:56.401606 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98f6c2eb-ae96-4378-95dd-5283eff55ade tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:56.402303 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98f6c2eb-ae96-4378-95dd-5283eff55ade tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:56.402880 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98f6c2eb-ae96-4378-95dd-5283eff55ade tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:56.403219 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-98f6c2eb-ae96-4378-95dd-5283eff55ade tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:56.547256 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-98f6c2eb-ae96-4378-95dd-5283eff55ade tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:56.556099 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-98f6c2eb-ae96-4378-95dd-5283eff55ade tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1503 microversion: 2.1 time: 0.173749 Aug 30 05:13:56.556661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 163/309] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:56 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:56.582667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7234f1a8-2804-4d3a-baf9-23212bfcbb9b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:56.583423 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7234f1a8-2804-4d3a-baf9-23212bfcbb9b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:56.591310 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7234f1a8-2804-4d3a-baf9-23212bfcbb9b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:56.592295 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7234f1a8-2804-4d3a-baf9-23212bfcbb9b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:56.592830 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7234f1a8-2804-4d3a-baf9-23212bfcbb9b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:56.594012 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7234f1a8-2804-4d3a-baf9-23212bfcbb9b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:56.594484 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7234f1a8-2804-4d3a-baf9-23212bfcbb9b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:56.594976 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7234f1a8-2804-4d3a-baf9-23212bfcbb9b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:56.749348 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7234f1a8-2804-4d3a-baf9-23212bfcbb9b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:56.758237 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7234f1a8-2804-4d3a-baf9-23212bfcbb9b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1319 microversion: 2.1 time: 0.180612 Aug 30 05:13:56.758794 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 147/310] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:56 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:56.992033 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-35cbf7ce-2ad8-46ad-93b2-69cd1c4a923b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:56.993023 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-35cbf7ce-2ad8-46ad-93b2-69cd1c4a923b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:56.999866 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35cbf7ce-2ad8-46ad-93b2-69cd1c4a923b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:57.000462 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35cbf7ce-2ad8-46ad-93b2-69cd1c4a923b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:57.000967 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35cbf7ce-2ad8-46ad-93b2-69cd1c4a923b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:57.002217 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35cbf7ce-2ad8-46ad-93b2-69cd1c4a923b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:57.002795 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35cbf7ce-2ad8-46ad-93b2-69cd1c4a923b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:57.003306 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35cbf7ce-2ad8-46ad-93b2-69cd1c4a923b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:57.141529 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2c5d3332-08ba-4b37-b504-78e6d288e94e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:57.142137 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2c5d3332-08ba-4b37-b504-78e6d288e94e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:57.159627 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c5d3332-08ba-4b37-b504-78e6d288e94e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:57.160327 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c5d3332-08ba-4b37-b504-78e6d288e94e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:57.160763 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c5d3332-08ba-4b37-b504-78e6d288e94e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:57.161631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c5d3332-08ba-4b37-b504-78e6d288e94e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:57.162243 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c5d3332-08ba-4b37-b504-78e6d288e94e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:57.163037 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c5d3332-08ba-4b37-b504-78e6d288e94e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:57.183002 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-35cbf7ce-2ad8-46ad-93b2-69cd1c4a923b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:57.191374 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2c5d3332-08ba-4b37-b504-78e6d288e94e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/ips" status: 200 len: 151 microversion: 2.20 time: 0.054655 Aug 30 05:13:57.191963 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 148/311] 10.222.0.77 () {60 vars in 1289 bytes} [Tue Aug 30 05:13:57 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/ips => generated 151 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:13:57.198293 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-35cbf7ce-2ad8-46ad-93b2-69cd1c4a923b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.206976 Aug 30 05:13:57.198293 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 164/312] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:56 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:57.581015 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-10377eb2-4c1f-4a6a-9cc5-201f26934725 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:57.581526 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-10377eb2-4c1f-4a6a-9cc5-201f26934725 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:57.587208 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10377eb2-4c1f-4a6a-9cc5-201f26934725 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:57.587695 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10377eb2-4c1f-4a6a-9cc5-201f26934725 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:57.588125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10377eb2-4c1f-4a6a-9cc5-201f26934725 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:57.588814 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10377eb2-4c1f-4a6a-9cc5-201f26934725 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:57.589260 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10377eb2-4c1f-4a6a-9cc5-201f26934725 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:57.589678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-10377eb2-4c1f-4a6a-9cc5-201f26934725 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:57.673819 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-10377eb2-4c1f-4a6a-9cc5-201f26934725 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b50d70f00f33494e81d4aac49df96dc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cea756f95e843b5868e53f6446d648a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:57.678593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:57.684932 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-10377eb2-4c1f-4a6a-9cc5-201f26934725 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 200 len: 1461 microversion: 2.1 time: 0.109280 Aug 30 05:13:57.685502 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 165/313] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:57 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 1461 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:57.748982 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-40ea1cbd-ee3c-40ea-9946-46f3c61ecc1e req-b7c7e6fd-4e99-419a-88b5-abcf991031f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "792da216-65d1-4514-8eca-250051397974", "name": "network-vif-deleted", "tag": "38cd1a99-b826-46f6-973e-bf6c13f95335"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:57.775292 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-40ea1cbd-ee3c-40ea-9946-46f3c61ecc1e req-b7c7e6fd-4e99-419a-88b5-abcf991031f6 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:57.776049 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-40ea1cbd-ee3c-40ea-9946-46f3c61ecc1e req-b7c7e6fd-4e99-419a-88b5-abcf991031f6 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:57.776708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-40ea1cbd-ee3c-40ea-9946-46f3c61ecc1e req-b7c7e6fd-4e99-419a-88b5-abcf991031f6 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:57.780425 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e71a1266-7848-480a-8bf2-0b198d2b9733 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:57.781272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e71a1266-7848-480a-8bf2-0b198d2b9733 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:57.793330 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e71a1266-7848-480a-8bf2-0b198d2b9733 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:57.794210 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e71a1266-7848-480a-8bf2-0b198d2b9733 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:57.795130 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e71a1266-7848-480a-8bf2-0b198d2b9733 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:57.796094 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e71a1266-7848-480a-8bf2-0b198d2b9733 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:57.796754 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-40ea1cbd-ee3c-40ea-9946-46f3c61ecc1e req-b7c7e6fd-4e99-419a-88b5-abcf991031f6 service nova] Creating event network-vif-deleted:38cd1a99-b826-46f6-973e-bf6c13f95335 for instance 792da216-65d1-4514-8eca-250051397974 on hv-cinder-85391 Aug 30 05:13:57.797224 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e71a1266-7848-480a-8bf2-0b198d2b9733 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:57.799347 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e71a1266-7848-480a-8bf2-0b198d2b9733 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:57.805752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-40ea1cbd-ee3c-40ea-9946-46f3c61ecc1e req-b7c7e6fd-4e99-419a-88b5-abcf991031f6 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060418 Aug 30 05:13:57.809028 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 149/314] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:57.986229 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e71a1266-7848-480a-8bf2-0b198d2b9733 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:57.996822 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e71a1266-7848-480a-8bf2-0b198d2b9733 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1319 microversion: 2.1 time: 0.219747 Aug 30 05:13:57.998325 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 166/315] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:57 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:58.222532 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a93a0a2a-a63d-4fb4-9911-a7100caea118 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:58.223910 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a93a0a2a-a63d-4fb4-9911-a7100caea118 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:58.234902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a93a0a2a-a63d-4fb4-9911-a7100caea118 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:58.235403 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a93a0a2a-a63d-4fb4-9911-a7100caea118 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:58.236060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a93a0a2a-a63d-4fb4-9911-a7100caea118 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:58.236773 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a93a0a2a-a63d-4fb4-9911-a7100caea118 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:58.237233 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a93a0a2a-a63d-4fb4-9911-a7100caea118 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:58.237660 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a93a0a2a-a63d-4fb4-9911-a7100caea118 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:58.412884 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a93a0a2a-a63d-4fb4-9911-a7100caea118 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:58.428650 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a93a0a2a-a63d-4fb4-9911-a7100caea118 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.211455 Aug 30 05:13:58.430844 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 150/316] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:58 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:58.707584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a08bb6b9-16f0-49cb-8b2e-e8d376ac7dd5 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:58.708210 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a08bb6b9-16f0-49cb-8b2e-e8d376ac7dd5 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] [instance: 792da216-65d1-4514-8eca-250051397974] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:58.715849 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a08bb6b9-16f0-49cb-8b2e-e8d376ac7dd5 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:58.716631 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a08bb6b9-16f0-49cb-8b2e-e8d376ac7dd5 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:58.717220 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a08bb6b9-16f0-49cb-8b2e-e8d376ac7dd5 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:58.718149 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a08bb6b9-16f0-49cb-8b2e-e8d376ac7dd5 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:58.719727 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a08bb6b9-16f0-49cb-8b2e-e8d376ac7dd5 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:58.720361 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a08bb6b9-16f0-49cb-8b2e-e8d376ac7dd5 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:58.739570 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-a08bb6b9-16f0-49cb-8b2e-e8d376ac7dd5 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] HTTP exception thrown: Instance 792da216-65d1-4514-8eca-250051397974 could not be found. Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a08bb6b9-16f0-49cb-8b2e-e8d376ac7dd5 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Request method failure captured: Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 HTTP/1.1 Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZxk6t2tUyMCy8dtozHuFOpPExbYagNpH1d_FcAmdfOUulvhVxqC0AIlTNy2suSQAroskCI2nqc4nP54nwajh2Ukv02Jkg2fJEbcl3J29VSFbwJFSdaCDgH9XuNvG09PDG5vLSVwGOxOA-dAgoSmAvfTPUSORj50Hw0FlwqKU-PhsGk Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 9cea756f95e843b5868e53f6446d648a Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesActionsTest-1374801759 Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:13:58.741382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:13:58.742685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/9cea756f95e843b5868e53f6446d648a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/9cea756f95e843b5868e53f6446d648a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/9cea756f95e843b5868e53f6446d648a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_9cea756f95e843b5868e53f6446d648a", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:13:58.742685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesActionsTest-1374801759 Aug 30 05:13:58.742685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 9cea756f95e843b5868e53f6446d648a Aug 30 05:13:58.742685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesActionsTest-1374801759 Aug 30 05:13:58.742685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesActionsTest-1374801759-project Aug 30 05:13:58.742685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:13:58.742685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:13:58.742685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: b50d70f00f33494e81d4aac49df96dc4 Aug 30 05:13:58.742685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesActionsTest-1374801759-project Aug 30 05:13:58.742685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:13:58.742685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 792da216-65d1-4514-8eca-250051397974 could not be found. Aug 30 05:13:58.742685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '792da216-65d1-4514-8eca-250051397974'} Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 792da216-65d1-4514-8eca-250051397974 could not be found. Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:13:58.743443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 792da216-65d1-4514-8eca-250051397974 could not be found. Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 792da216-65d1-4514-8eca-250051397974 could not be found. Aug 30 05:13:58.744595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:13:58.747907 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a08bb6b9-16f0-49cb-8b2e-e8d376ac7dd5 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] Returning 404 to user: Instance 792da216-65d1-4514-8eca-250051397974 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:13:58.747907 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a08bb6b9-16f0-49cb-8b2e-e8d376ac7dd5 tempest-VolumesActionsTest-1374801759 tempest-VolumesActionsTest-1374801759-project] 10.222.0.77 "GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974" status: 404 len: 111 microversion: 2.1 time: 0.039598 Aug 30 05:13:58.749090 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 167/317] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:58 2022] GET /compute/v2.1/servers/792da216-65d1-4514-8eca-250051397974 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:13:59.018163 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-29d29f38-1e23-4486-80f7-89f7b1c8d727 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:59.018898 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-29d29f38-1e23-4486-80f7-89f7b1c8d727 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:59.027896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29d29f38-1e23-4486-80f7-89f7b1c8d727 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:59.028931 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29d29f38-1e23-4486-80f7-89f7b1c8d727 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:59.029942 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29d29f38-1e23-4486-80f7-89f7b1c8d727 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:59.031489 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29d29f38-1e23-4486-80f7-89f7b1c8d727 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:59.033053 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29d29f38-1e23-4486-80f7-89f7b1c8d727 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:59.033729 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-29d29f38-1e23-4486-80f7-89f7b1c8d727 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:59.273535 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-29d29f38-1e23-4486-80f7-89f7b1c8d727 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:59.283779 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-29d29f38-1e23-4486-80f7-89f7b1c8d727 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1319 microversion: 2.1 time: 0.269894 Aug 30 05:13:59.284791 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 151/318] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:59 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:59.452765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8de69c8c-3a16-4683-9052-bc6118a96ad9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:59.453595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8de69c8c-3a16-4683-9052-bc6118a96ad9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:59.456143 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:59.463141 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:59.465214 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8de69c8c-3a16-4683-9052-bc6118a96ad9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:59.465892 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8de69c8c-3a16-4683-9052-bc6118a96ad9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:59.466340 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8de69c8c-3a16-4683-9052-bc6118a96ad9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:59.469220 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8de69c8c-3a16-4683-9052-bc6118a96ad9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:59.469589 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8de69c8c-3a16-4683-9052-bc6118a96ad9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:59.470702 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8de69c8c-3a16-4683-9052-bc6118a96ad9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:59.607073 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8de69c8c-3a16-4683-9052-bc6118a96ad9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:59.614942 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8de69c8c-3a16-4683-9052-bc6118a96ad9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.166661 Aug 30 05:13:59.615563 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 168/319] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:59 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:59.670445 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e0c5e677-c19a-4f4c-a6ff-980fbcfb8107 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:59.671017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e0c5e677-c19a-4f4c-a6ff-980fbcfb8107 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:59.672947 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:59.678704 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0c5e677-c19a-4f4c-a6ff-980fbcfb8107 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:59.679228 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0c5e677-c19a-4f4c-a6ff-980fbcfb8107 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:59.679673 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0c5e677-c19a-4f4c-a6ff-980fbcfb8107 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:59.680378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0c5e677-c19a-4f4c-a6ff-980fbcfb8107 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:59.680807 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0c5e677-c19a-4f4c-a6ff-980fbcfb8107 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:59.681258 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0c5e677-c19a-4f4c-a6ff-980fbcfb8107 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:59.705417 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-e0c5e677-c19a-4f4c-a6ff-980fbcfb8107 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lazy-loading 'flavor' on Instance uuid 5f83c589-3a23-45aa-96c5-3cf9006b3830 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:13:59.753124 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:59.882421 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e0c5e677-c19a-4f4c-a6ff-980fbcfb8107 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "POST /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/action" status: 202 len: 0 microversion: 2.20 time: 0.215554 Aug 30 05:13:59.883146 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 152/320] 10.222.0.77 () {62 vars in 1319 bytes} [Tue Aug 30 05:13:59 2022] POST /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 05:13:59.891583 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c9c38e1a-30f2-447a-a87c-b73e602b6c4a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:59.892883 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c9c38e1a-30f2-447a-a87c-b73e602b6c4a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:59.898630 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9c38e1a-30f2-447a-a87c-b73e602b6c4a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:59.899162 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9c38e1a-30f2-447a-a87c-b73e602b6c4a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:59.899602 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9c38e1a-30f2-447a-a87c-b73e602b6c4a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:59.900291 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9c38e1a-30f2-447a-a87c-b73e602b6c4a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:59.900831 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9c38e1a-30f2-447a-a87c-b73e602b6c4a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:59.901195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9c38e1a-30f2-447a-a87c-b73e602b6c4a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:00.016772 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-036538fe-4d96-4534-9763-d7ed105bf04c req-97603004-e402-4aaf-bb20-76f5de292917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48af496a-2b9e-4b18-aad8-59e43cfa075b", "name": "network-vif-plugged", "status": "completed", "tag": "b0c9e9dd-7bc1-4662-8798-666b8b9584c8"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:00.032133 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-036538fe-4d96-4534-9763-d7ed105bf04c req-97603004-e402-4aaf-bb20-76f5de292917 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:00.032732 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-036538fe-4d96-4534-9763-d7ed105bf04c req-97603004-e402-4aaf-bb20-76f5de292917 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:00.032946 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-036538fe-4d96-4534-9763-d7ed105bf04c req-97603004-e402-4aaf-bb20-76f5de292917 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:00.044884 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-036538fe-4d96-4534-9763-d7ed105bf04c req-97603004-e402-4aaf-bb20-76f5de292917 service nova] Creating event network-vif-plugged:b0c9e9dd-7bc1-4662-8798-666b8b9584c8 for instance 48af496a-2b9e-4b18-aad8-59e43cfa075b on hv-cinder-85391 Aug 30 05:14:00.050091 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-036538fe-4d96-4534-9763-d7ed105bf04c req-97603004-e402-4aaf-bb20-76f5de292917 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037374 Aug 30 05:14:00.051330 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 153/321] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:14:00.052521 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c9c38e1a-30f2-447a-a87c-b73e602b6c4a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:00.062977 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c9c38e1a-30f2-447a-a87c-b73e602b6c4a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:00.065554 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c9c38e1a-30f2-447a-a87c-b73e602b6c4a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:00.066738 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c9c38e1a-30f2-447a-a87c-b73e602b6c4a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.179168 Aug 30 05:14:00.067316 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 169/322] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:13:59 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:00.306344 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-50480bf2-2882-4d71-bc08-82cd86b7a497 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:00.307083 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-50480bf2-2882-4d71-bc08-82cd86b7a497 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:00.313213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50480bf2-2882-4d71-bc08-82cd86b7a497 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:00.314230 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50480bf2-2882-4d71-bc08-82cd86b7a497 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:00.314677 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50480bf2-2882-4d71-bc08-82cd86b7a497 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:00.315398 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50480bf2-2882-4d71-bc08-82cd86b7a497 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:00.315854 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50480bf2-2882-4d71-bc08-82cd86b7a497 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:00.316278 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-50480bf2-2882-4d71-bc08-82cd86b7a497 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:00.437021 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b7692503-0e18-44a5-9dd0-d330ad31c635 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd53c05e-4b78-4b9c-982c-5989bede3106"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:00.440083 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b7692503-0e18-44a5-9dd0-d330ad31c635 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:00.445960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7692503-0e18-44a5-9dd0-d330ad31c635 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:00.446444 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7692503-0e18-44a5-9dd0-d330ad31c635 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:00.446952 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7692503-0e18-44a5-9dd0-d330ad31c635 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:00.447646 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7692503-0e18-44a5-9dd0-d330ad31c635 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:00.448095 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7692503-0e18-44a5-9dd0-d330ad31c635 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:00.448515 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7692503-0e18-44a5-9dd0-d330ad31c635 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:00.449640 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-50480bf2-2882-4d71-bc08-82cd86b7a497 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:00.461376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-50480bf2-2882-4d71-bc08-82cd86b7a497 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1319 microversion: 2.1 time: 0.159629 Aug 30 05:14:00.462144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 154/323] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:00 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:00.636306 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b2896cfd-479e-48bd-bede-ce02edce8840 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:00.636980 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b2896cfd-479e-48bd-bede-ce02edce8840 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:00.643005 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2896cfd-479e-48bd-bede-ce02edce8840 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:00.643495 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2896cfd-479e-48bd-bede-ce02edce8840 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:00.643934 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2896cfd-479e-48bd-bede-ce02edce8840 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:00.644622 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2896cfd-479e-48bd-bede-ce02edce8840 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:00.645079 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2896cfd-479e-48bd-bede-ce02edce8840 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:00.645505 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b2896cfd-479e-48bd-bede-ce02edce8840 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:00.768409 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b2896cfd-479e-48bd-bede-ce02edce8840 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:00.776071 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b2896cfd-479e-48bd-bede-ce02edce8840 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.143763 Aug 30 05:14:00.776637 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 155/324] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:00 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:01.089431 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ca427625-6e6b-499f-bd37-4274459fe54d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:01.090065 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ca427625-6e6b-499f-bd37-4274459fe54d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:01.097281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca427625-6e6b-499f-bd37-4274459fe54d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:01.097769 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca427625-6e6b-499f-bd37-4274459fe54d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:01.098209 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca427625-6e6b-499f-bd37-4274459fe54d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:01.098930 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca427625-6e6b-499f-bd37-4274459fe54d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:01.099390 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca427625-6e6b-499f-bd37-4274459fe54d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:01.099846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca427625-6e6b-499f-bd37-4274459fe54d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:01.232672 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ca427625-6e6b-499f-bd37-4274459fe54d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:01.240804 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ca427625-6e6b-499f-bd37-4274459fe54d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:01.242269 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ca427625-6e6b-499f-bd37-4274459fe54d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:01.243542 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ca427625-6e6b-499f-bd37-4274459fe54d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.157999 Aug 30 05:14:01.244102 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 156/325] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:01 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:14:01.482785 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d0a4730c-d4ca-44bb-9d38-aa9cf16b7f28 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:01.483453 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d0a4730c-d4ca-44bb-9d38-aa9cf16b7f28 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:01.489418 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0a4730c-d4ca-44bb-9d38-aa9cf16b7f28 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:01.489907 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0a4730c-d4ca-44bb-9d38-aa9cf16b7f28 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:01.490346 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0a4730c-d4ca-44bb-9d38-aa9cf16b7f28 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:01.491076 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0a4730c-d4ca-44bb-9d38-aa9cf16b7f28 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:01.491540 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0a4730c-d4ca-44bb-9d38-aa9cf16b7f28 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:01.491969 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0a4730c-d4ca-44bb-9d38-aa9cf16b7f28 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:01.620855 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d0a4730c-d4ca-44bb-9d38-aa9cf16b7f28 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:01.629018 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d0a4730c-d4ca-44bb-9d38-aa9cf16b7f28 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1319 microversion: 2.1 time: 0.150163 Aug 30 05:14:01.629580 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 157/326] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:01 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:01.797362 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7d36de07-a502-44ba-82b4-d1118ad72667 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:01.798459 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7d36de07-a502-44ba-82b4-d1118ad72667 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:01.804431 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d36de07-a502-44ba-82b4-d1118ad72667 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:01.804909 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d36de07-a502-44ba-82b4-d1118ad72667 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:01.805341 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d36de07-a502-44ba-82b4-d1118ad72667 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:01.806018 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d36de07-a502-44ba-82b4-d1118ad72667 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:01.806467 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d36de07-a502-44ba-82b4-d1118ad72667 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:01.806945 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7d36de07-a502-44ba-82b4-d1118ad72667 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:01.939977 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7d36de07-a502-44ba-82b4-d1118ad72667 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:01.947656 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7d36de07-a502-44ba-82b4-d1118ad72667 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.154109 Aug 30 05:14:01.948251 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 158/327] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:01 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:02.266846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-da3d4ff2-1847-4f33-a627-71516f883d09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:02.267486 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-da3d4ff2-1847-4f33-a627-71516f883d09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:02.273824 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da3d4ff2-1847-4f33-a627-71516f883d09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:02.274316 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da3d4ff2-1847-4f33-a627-71516f883d09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:02.274751 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da3d4ff2-1847-4f33-a627-71516f883d09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:02.275481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da3d4ff2-1847-4f33-a627-71516f883d09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:02.275946 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da3d4ff2-1847-4f33-a627-71516f883d09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:02.276364 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da3d4ff2-1847-4f33-a627-71516f883d09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:02.406354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-da3d4ff2-1847-4f33-a627-71516f883d09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:02.414964 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-da3d4ff2-1847-4f33-a627-71516f883d09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:02.416400 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-da3d4ff2-1847-4f33-a627-71516f883d09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:02.417547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-da3d4ff2-1847-4f33-a627-71516f883d09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.154854 Aug 30 05:14:02.418098 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 159/328] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:02 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:14:02.649562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-add9043f-432f-4ab2-9e2b-7de48dab11bc tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:02.650170 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-add9043f-432f-4ab2-9e2b-7de48dab11bc tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:02.656098 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-add9043f-432f-4ab2-9e2b-7de48dab11bc tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:02.656578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-add9043f-432f-4ab2-9e2b-7de48dab11bc tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:02.657009 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-add9043f-432f-4ab2-9e2b-7de48dab11bc tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:02.658331 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-add9043f-432f-4ab2-9e2b-7de48dab11bc tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:02.658785 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-add9043f-432f-4ab2-9e2b-7de48dab11bc tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:02.659230 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-add9043f-432f-4ab2-9e2b-7de48dab11bc tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:02.789871 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-add9043f-432f-4ab2-9e2b-7de48dab11bc tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:02.797303 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-add9043f-432f-4ab2-9e2b-7de48dab11bc tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1319 microversion: 2.1 time: 0.151559 Aug 30 05:14:02.797855 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 160/329] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:02 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:02.968444 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-015a79ac-7b98-488a-880e-4ec253102cc5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:02.969253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-015a79ac-7b98-488a-880e-4ec253102cc5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:02.975113 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-015a79ac-7b98-488a-880e-4ec253102cc5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:02.975594 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-015a79ac-7b98-488a-880e-4ec253102cc5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:02.976022 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-015a79ac-7b98-488a-880e-4ec253102cc5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:02.976703 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-015a79ac-7b98-488a-880e-4ec253102cc5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:02.977153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-015a79ac-7b98-488a-880e-4ec253102cc5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:02.977577 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-015a79ac-7b98-488a-880e-4ec253102cc5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:03.121186 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-015a79ac-7b98-488a-880e-4ec253102cc5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:03.130857 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-015a79ac-7b98-488a-880e-4ec253102cc5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.166277 Aug 30 05:14:03.134954 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 161/330] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:02 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:03.229967 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b7692503-0e18-44a5-9dd0-d330ad31c635 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "POST /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.796622 Aug 30 05:14:03.230934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 170/331] 10.222.0.77 () {60 vars in 1323 bytes} [Tue Aug 30 05:14:00 2022] POST /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/os-volume_attachments => generated 194 bytes in 2798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:14:03.441619 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ee5f82af-df37-4841-8f09-b11905d2e304 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:03.442237 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ee5f82af-df37-4841-8f09-b11905d2e304 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:03.448651 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee5f82af-df37-4841-8f09-b11905d2e304 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:03.449130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee5f82af-df37-4841-8f09-b11905d2e304 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:03.449565 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee5f82af-df37-4841-8f09-b11905d2e304 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:03.450280 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee5f82af-df37-4841-8f09-b11905d2e304 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:03.450733 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee5f82af-df37-4841-8f09-b11905d2e304 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:03.451253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee5f82af-df37-4841-8f09-b11905d2e304 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:03.590625 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ee5f82af-df37-4841-8f09-b11905d2e304 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:03.599828 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ee5f82af-df37-4841-8f09-b11905d2e304 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:03.601503 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ee5f82af-df37-4841-8f09-b11905d2e304 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:03.602882 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ee5f82af-df37-4841-8f09-b11905d2e304 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.165754 Aug 30 05:14:03.610136 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 162/332] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:03 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:03.817960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f31888ba-419a-4c80-8cca-5cacb99e8594 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:03.818694 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f31888ba-419a-4c80-8cca-5cacb99e8594 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:03.825328 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f31888ba-419a-4c80-8cca-5cacb99e8594 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:03.825814 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f31888ba-419a-4c80-8cca-5cacb99e8594 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:03.826252 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f31888ba-419a-4c80-8cca-5cacb99e8594 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:03.826978 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f31888ba-419a-4c80-8cca-5cacb99e8594 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:03.827432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f31888ba-419a-4c80-8cca-5cacb99e8594 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:03.827860 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f31888ba-419a-4c80-8cca-5cacb99e8594 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:03.956044 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f31888ba-419a-4c80-8cca-5cacb99e8594 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:03.964197 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f31888ba-419a-4c80-8cca-5cacb99e8594 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1319 microversion: 2.1 time: 0.150376 Aug 30 05:14:03.972212 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 171/333] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:03 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:04.152389 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bc61d571-f478-46a2-a426-917762fc35ef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:04.153001 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bc61d571-f478-46a2-a426-917762fc35ef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:04.159563 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc61d571-f478-46a2-a426-917762fc35ef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:04.160046 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc61d571-f478-46a2-a426-917762fc35ef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:04.160481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc61d571-f478-46a2-a426-917762fc35ef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:04.161174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc61d571-f478-46a2-a426-917762fc35ef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:04.161628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc61d571-f478-46a2-a426-917762fc35ef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:04.162058 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc61d571-f478-46a2-a426-917762fc35ef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:04.299097 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bc61d571-f478-46a2-a426-917762fc35ef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:04.322063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bc61d571-f478-46a2-a426-917762fc35ef tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.163519 Aug 30 05:14:04.323038 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 163/334] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:04 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:04.626709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6989ff4b-33af-42a4-8c1f-d51f0b173a81 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:04.627278 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6989ff4b-33af-42a4-8c1f-d51f0b173a81 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:04.633524 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6989ff4b-33af-42a4-8c1f-d51f0b173a81 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:04.633996 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6989ff4b-33af-42a4-8c1f-d51f0b173a81 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:04.634422 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6989ff4b-33af-42a4-8c1f-d51f0b173a81 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:04.635140 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6989ff4b-33af-42a4-8c1f-d51f0b173a81 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:04.635588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6989ff4b-33af-42a4-8c1f-d51f0b173a81 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:04.636005 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6989ff4b-33af-42a4-8c1f-d51f0b173a81 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:04.810104 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6989ff4b-33af-42a4-8c1f-d51f0b173a81 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:04.819631 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6989ff4b-33af-42a4-8c1f-d51f0b173a81 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:04.821156 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6989ff4b-33af-42a4-8c1f-d51f0b173a81 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:04.822477 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6989ff4b-33af-42a4-8c1f-d51f0b173a81 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.200255 Aug 30 05:14:04.823052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 172/335] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:04 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:04.989653 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-268a73be-c354-4adf-bfde-8991089f13b1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:04.991430 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-268a73be-c354-4adf-bfde-8991089f13b1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:04.998406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-268a73be-c354-4adf-bfde-8991089f13b1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:04.999006 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-268a73be-c354-4adf-bfde-8991089f13b1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:04.999511 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-268a73be-c354-4adf-bfde-8991089f13b1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:05.000218 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-268a73be-c354-4adf-bfde-8991089f13b1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:05.000675 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-268a73be-c354-4adf-bfde-8991089f13b1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:05.001101 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-268a73be-c354-4adf-bfde-8991089f13b1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:05.137011 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-268a73be-c354-4adf-bfde-8991089f13b1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:05.149643 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-268a73be-c354-4adf-bfde-8991089f13b1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1507 microversion: 2.1 time: 0.165902 Aug 30 05:14:05.156504 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 164/336] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:04 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:05.348722 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c039207f-5830-4840-844e-5e0f0c11fac8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:05.349338 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c039207f-5830-4840-844e-5e0f0c11fac8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:05.355348 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c039207f-5830-4840-844e-5e0f0c11fac8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:05.355840 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c039207f-5830-4840-844e-5e0f0c11fac8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:05.356298 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c039207f-5830-4840-844e-5e0f0c11fac8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:05.356972 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c039207f-5830-4840-844e-5e0f0c11fac8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:05.357430 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c039207f-5830-4840-844e-5e0f0c11fac8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:05.357857 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c039207f-5830-4840-844e-5e0f0c11fac8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:05.515078 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c039207f-5830-4840-844e-5e0f0c11fac8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:05.524391 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c039207f-5830-4840-844e-5e0f0c11fac8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.179815 Aug 30 05:14:05.539003 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 173/337] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:05 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:05.846088 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4496496f-0472-4481-bf98-bcab8de1f5d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:05.847079 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4496496f-0472-4481-bf98-bcab8de1f5d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:05.854143 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4496496f-0472-4481-bf98-bcab8de1f5d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:05.861856 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4496496f-0472-4481-bf98-bcab8de1f5d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:05.862665 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4496496f-0472-4481-bf98-bcab8de1f5d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:05.863688 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4496496f-0472-4481-bf98-bcab8de1f5d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:05.864196 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4496496f-0472-4481-bf98-bcab8de1f5d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:05.864832 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4496496f-0472-4481-bf98-bcab8de1f5d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:06.033428 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4496496f-0472-4481-bf98-bcab8de1f5d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:06.045078 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4496496f-0472-4481-bf98-bcab8de1f5d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:06.047059 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4496496f-0472-4481-bf98-bcab8de1f5d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:06.048430 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4496496f-0472-4481-bf98-bcab8de1f5d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.207023 Aug 30 05:14:06.049089 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 165/338] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:05 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:06.545917 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-22dc270e-ebd6-4ab5-bab8-3cbd54d45250 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:06.546505 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-22dc270e-ebd6-4ab5-bab8-3cbd54d45250 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:06.553528 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22dc270e-ebd6-4ab5-bab8-3cbd54d45250 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:06.554008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22dc270e-ebd6-4ab5-bab8-3cbd54d45250 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:06.554440 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22dc270e-ebd6-4ab5-bab8-3cbd54d45250 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:06.555151 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22dc270e-ebd6-4ab5-bab8-3cbd54d45250 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:06.555599 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22dc270e-ebd6-4ab5-bab8-3cbd54d45250 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:06.556018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-22dc270e-ebd6-4ab5-bab8-3cbd54d45250 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:06.713321 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-22dc270e-ebd6-4ab5-bab8-3cbd54d45250 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:06.718213 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-22dc270e-ebd6-4ab5-bab8-3cbd54d45250 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.174321 Aug 30 05:14:06.719303 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 174/339] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:06 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:07.072154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b88b5d8e-6820-42cb-b8ad-72b89e93a4c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:07.072778 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b88b5d8e-6820-42cb-b8ad-72b89e93a4c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:07.079288 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b88b5d8e-6820-42cb-b8ad-72b89e93a4c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:07.079777 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b88b5d8e-6820-42cb-b8ad-72b89e93a4c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:07.080587 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b88b5d8e-6820-42cb-b8ad-72b89e93a4c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:07.081322 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b88b5d8e-6820-42cb-b8ad-72b89e93a4c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:07.081785 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b88b5d8e-6820-42cb-b8ad-72b89e93a4c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:07.082218 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b88b5d8e-6820-42cb-b8ad-72b89e93a4c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:07.227924 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b88b5d8e-6820-42cb-b8ad-72b89e93a4c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:07.238844 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b88b5d8e-6820-42cb-b8ad-72b89e93a4c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:07.241821 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b88b5d8e-6820-42cb-b8ad-72b89e93a4c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:07.243066 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b88b5d8e-6820-42cb-b8ad-72b89e93a4c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.174822 Aug 30 05:14:07.243621 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 166/340] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:07 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:07.740770 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a49c8009-e0de-469a-9d30-4eca1df4f7e0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:07.741506 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a49c8009-e0de-469a-9d30-4eca1df4f7e0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:07.747773 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a49c8009-e0de-469a-9d30-4eca1df4f7e0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:07.748263 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a49c8009-e0de-469a-9d30-4eca1df4f7e0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:07.748705 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a49c8009-e0de-469a-9d30-4eca1df4f7e0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:07.749443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a49c8009-e0de-469a-9d30-4eca1df4f7e0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:07.749880 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a49c8009-e0de-469a-9d30-4eca1df4f7e0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:07.750307 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a49c8009-e0de-469a-9d30-4eca1df4f7e0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:07.904216 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a49c8009-e0de-469a-9d30-4eca1df4f7e0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:07.912330 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a49c8009-e0de-469a-9d30-4eca1df4f7e0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.176412 Aug 30 05:14:07.912923 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 175/341] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:07 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:08.268525 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-40587efe-2c5f-40a8-a7ec-a0d7341262ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:08.269999 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-40587efe-2c5f-40a8-a7ec-a0d7341262ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:08.276878 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40587efe-2c5f-40a8-a7ec-a0d7341262ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:08.277401 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40587efe-2c5f-40a8-a7ec-a0d7341262ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:08.277875 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40587efe-2c5f-40a8-a7ec-a0d7341262ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:08.278577 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40587efe-2c5f-40a8-a7ec-a0d7341262ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:08.279092 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40587efe-2c5f-40a8-a7ec-a0d7341262ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:08.279578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40587efe-2c5f-40a8-a7ec-a0d7341262ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:08.426451 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-40587efe-2c5f-40a8-a7ec-a0d7341262ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:08.440417 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-40587efe-2c5f-40a8-a7ec-a0d7341262ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:08.442254 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-40587efe-2c5f-40a8-a7ec-a0d7341262ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:08.443618 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-40587efe-2c5f-40a8-a7ec-a0d7341262ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.179717 Aug 30 05:14:08.444231 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 167/342] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:08 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:08.932752 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-29e09a91-696f-4d43-a9ac-c43c28c56b6b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:08.933362 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-29e09a91-696f-4d43-a9ac-c43c28c56b6b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:08.939710 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29e09a91-696f-4d43-a9ac-c43c28c56b6b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:08.940188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29e09a91-696f-4d43-a9ac-c43c28c56b6b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:08.940618 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29e09a91-696f-4d43-a9ac-c43c28c56b6b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:08.941294 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29e09a91-696f-4d43-a9ac-c43c28c56b6b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:08.941739 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29e09a91-696f-4d43-a9ac-c43c28c56b6b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:08.942155 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29e09a91-696f-4d43-a9ac-c43c28c56b6b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:09.072177 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-29e09a91-696f-4d43-a9ac-c43c28c56b6b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:09.079873 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-29e09a91-696f-4d43-a9ac-c43c28c56b6b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.150938 Aug 30 05:14:09.080927 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 176/343] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:08 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:09.469244 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0ee7c7a0-bf5c-4287-ae4d-58027c2c27ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:09.472252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0ee7c7a0-bf5c-4287-ae4d-58027c2c27ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:09.481226 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ee7c7a0-bf5c-4287-ae4d-58027c2c27ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:09.481791 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ee7c7a0-bf5c-4287-ae4d-58027c2c27ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:09.482298 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ee7c7a0-bf5c-4287-ae4d-58027c2c27ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:09.483104 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ee7c7a0-bf5c-4287-ae4d-58027c2c27ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:09.483624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ee7c7a0-bf5c-4287-ae4d-58027c2c27ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:09.484131 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ee7c7a0-bf5c-4287-ae4d-58027c2c27ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:09.647948 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0ee7c7a0-bf5c-4287-ae4d-58027c2c27ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:09.678070 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0ee7c7a0-bf5c-4287-ae4d-58027c2c27ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:09.680086 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0ee7c7a0-bf5c-4287-ae4d-58027c2c27ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:09.681743 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0ee7c7a0-bf5c-4287-ae4d-58027c2c27ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.218725 Aug 30 05:14:09.682497 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 168/344] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:09 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:10.100641 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4ac77f83-56da-4fd9-9e82-d64036b8adf1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:10.101542 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4ac77f83-56da-4fd9-9e82-d64036b8adf1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:10.113878 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ac77f83-56da-4fd9-9e82-d64036b8adf1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:10.114527 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ac77f83-56da-4fd9-9e82-d64036b8adf1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:10.115222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ac77f83-56da-4fd9-9e82-d64036b8adf1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:10.116084 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ac77f83-56da-4fd9-9e82-d64036b8adf1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:10.116561 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ac77f83-56da-4fd9-9e82-d64036b8adf1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:10.117071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4ac77f83-56da-4fd9-9e82-d64036b8adf1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:10.330087 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4ac77f83-56da-4fd9-9e82-d64036b8adf1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:10.339363 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4ac77f83-56da-4fd9-9e82-d64036b8adf1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.242457 Aug 30 05:14:10.343256 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 177/345] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:10 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:10.707524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-00f4231c-ea55-4bb8-ba71-62e577429e65 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:10.708167 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-00f4231c-ea55-4bb8-ba71-62e577429e65 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:10.715783 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00f4231c-ea55-4bb8-ba71-62e577429e65 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:10.716359 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00f4231c-ea55-4bb8-ba71-62e577429e65 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:10.716831 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00f4231c-ea55-4bb8-ba71-62e577429e65 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:10.717581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00f4231c-ea55-4bb8-ba71-62e577429e65 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:10.718070 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00f4231c-ea55-4bb8-ba71-62e577429e65 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:10.718793 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-00f4231c-ea55-4bb8-ba71-62e577429e65 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:10.739430 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:10.866776 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6d1ed611-22bc-4472-99f1-a55f1ec5eef8 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:10.873070 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d1ed611-22bc-4472-99f1-a55f1ec5eef8 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:10.873823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d1ed611-22bc-4472-99f1-a55f1ec5eef8 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:10.874491 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6d1ed611-22bc-4472-99f1-a55f1ec5eef8 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:10.896057 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-00f4231c-ea55-4bb8-ba71-62e577429e65 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:10.906021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-00f4231c-ea55-4bb8-ba71-62e577429e65 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:10.908083 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-00f4231c-ea55-4bb8-ba71-62e577429e65 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:10.910052 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-00f4231c-ea55-4bb8-ba71-62e577429e65 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.208065 Aug 30 05:14:10.914991 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 169/346] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:10 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:10.954038 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6d1ed611-22bc-4472-99f1-a55f1ec5eef8 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Going to try to stop instance {{(pid=120572) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 05:14:11.029134 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6d1ed611-22bc-4472-99f1-a55f1ec5eef8 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "POST /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/action" status: 202 len: 0 microversion: 2.1 time: 0.165945 Aug 30 05:14:11.031271 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 178/347] 10.222.0.77 () {60 vars in 1278 bytes} [Tue Aug 30 05:14:10 2022] POST /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 05:14:11.046024 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3eac9fec-663b-4f38-897d-6825f4e10086 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:11.051313 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3eac9fec-663b-4f38-897d-6825f4e10086 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:11.067692 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eac9fec-663b-4f38-897d-6825f4e10086 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:11.068345 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eac9fec-663b-4f38-897d-6825f4e10086 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:11.069021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eac9fec-663b-4f38-897d-6825f4e10086 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:11.069975 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eac9fec-663b-4f38-897d-6825f4e10086 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:11.070531 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eac9fec-663b-4f38-897d-6825f4e10086 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:11.071196 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3eac9fec-663b-4f38-897d-6825f4e10086 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:11.246392 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3eac9fec-663b-4f38-897d-6825f4e10086 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:11.256228 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3eac9fec-663b-4f38-897d-6825f4e10086 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1722 microversion: 2.1 time: 0.216862 Aug 30 05:14:11.257100 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 170/348] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:11 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:11.368389 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9d3fdcc5-90a6-4d8f-bab9-6b7f7bed581c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:11.369248 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9d3fdcc5-90a6-4d8f-bab9-6b7f7bed581c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:11.379334 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d3fdcc5-90a6-4d8f-bab9-6b7f7bed581c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:11.379923 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d3fdcc5-90a6-4d8f-bab9-6b7f7bed581c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:11.380590 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d3fdcc5-90a6-4d8f-bab9-6b7f7bed581c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:11.381360 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d3fdcc5-90a6-4d8f-bab9-6b7f7bed581c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:11.382003 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d3fdcc5-90a6-4d8f-bab9-6b7f7bed581c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:11.382657 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d3fdcc5-90a6-4d8f-bab9-6b7f7bed581c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:11.548544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9d3fdcc5-90a6-4d8f-bab9-6b7f7bed581c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:11.557119 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9d3fdcc5-90a6-4d8f-bab9-6b7f7bed581c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.193578 Aug 30 05:14:11.557889 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 179/349] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:11 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:11.936564 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ae2f29b5-33e5-48d0-a0b4-11ea7b12d62e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:11.937854 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ae2f29b5-33e5-48d0-a0b4-11ea7b12d62e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:11.945866 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae2f29b5-33e5-48d0-a0b4-11ea7b12d62e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:11.946393 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae2f29b5-33e5-48d0-a0b4-11ea7b12d62e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:11.947087 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae2f29b5-33e5-48d0-a0b4-11ea7b12d62e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:11.947809 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae2f29b5-33e5-48d0-a0b4-11ea7b12d62e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:11.948269 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae2f29b5-33e5-48d0-a0b4-11ea7b12d62e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:11.948888 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae2f29b5-33e5-48d0-a0b4-11ea7b12d62e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:12.134902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ae2f29b5-33e5-48d0-a0b4-11ea7b12d62e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:12.143549 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ae2f29b5-33e5-48d0-a0b4-11ea7b12d62e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:12.145008 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ae2f29b5-33e5-48d0-a0b4-11ea7b12d62e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:12.147029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ae2f29b5-33e5-48d0-a0b4-11ea7b12d62e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.214878 Aug 30 05:14:12.147588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 171/350] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:11 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:12.277753 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4c9e7e97-40f6-42d5-ba34-28a7e93d7b83 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:12.278489 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4c9e7e97-40f6-42d5-ba34-28a7e93d7b83 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:12.284924 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9e7e97-40f6-42d5-ba34-28a7e93d7b83 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:12.285642 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9e7e97-40f6-42d5-ba34-28a7e93d7b83 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:12.286362 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9e7e97-40f6-42d5-ba34-28a7e93d7b83 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:12.287323 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9e7e97-40f6-42d5-ba34-28a7e93d7b83 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:12.287778 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9e7e97-40f6-42d5-ba34-28a7e93d7b83 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:12.288380 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c9e7e97-40f6-42d5-ba34-28a7e93d7b83 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:12.477278 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4c9e7e97-40f6-42d5-ba34-28a7e93d7b83 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:12.480956 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:12.488635 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4c9e7e97-40f6-42d5-ba34-28a7e93d7b83 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1722 microversion: 2.1 time: 0.214692 Aug 30 05:14:12.504024 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 180/351] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:12 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:12.577663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-23f9b7ba-7baa-483a-9b68-0943f1de4262 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:12.578289 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-23f9b7ba-7baa-483a-9b68-0943f1de4262 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:12.585223 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23f9b7ba-7baa-483a-9b68-0943f1de4262 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:12.585724 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23f9b7ba-7baa-483a-9b68-0943f1de4262 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:12.586161 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23f9b7ba-7baa-483a-9b68-0943f1de4262 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:12.587061 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23f9b7ba-7baa-483a-9b68-0943f1de4262 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:12.587677 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23f9b7ba-7baa-483a-9b68-0943f1de4262 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:12.588275 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23f9b7ba-7baa-483a-9b68-0943f1de4262 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:12.743699 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-23f9b7ba-7baa-483a-9b68-0943f1de4262 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:12.752555 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-23f9b7ba-7baa-483a-9b68-0943f1de4262 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.178267 Aug 30 05:14:12.753125 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 172/352] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:12 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:13.174604 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-66c53b40-b407-4b0c-90e2-aaa55097de35 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:13.175405 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-66c53b40-b407-4b0c-90e2-aaa55097de35 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:13.185756 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66c53b40-b407-4b0c-90e2-aaa55097de35 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:13.186410 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66c53b40-b407-4b0c-90e2-aaa55097de35 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:13.187163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66c53b40-b407-4b0c-90e2-aaa55097de35 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:13.188891 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66c53b40-b407-4b0c-90e2-aaa55097de35 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:13.189544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66c53b40-b407-4b0c-90e2-aaa55097de35 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:13.191091 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66c53b40-b407-4b0c-90e2-aaa55097de35 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:13.347852 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-66c53b40-b407-4b0c-90e2-aaa55097de35 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:13.356367 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-66c53b40-b407-4b0c-90e2-aaa55097de35 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:13.358010 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-66c53b40-b407-4b0c-90e2-aaa55097de35 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:13.359586 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-66c53b40-b407-4b0c-90e2-aaa55097de35 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.190006 Aug 30 05:14:13.360684 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 181/353] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:13 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:13.514200 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0d86ee04-d04c-49c4-8079-f490c31d4822 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:13.515597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0d86ee04-d04c-49c4-8079-f490c31d4822 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:13.525812 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d86ee04-d04c-49c4-8079-f490c31d4822 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:13.527625 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d86ee04-d04c-49c4-8079-f490c31d4822 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:13.528283 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d86ee04-d04c-49c4-8079-f490c31d4822 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:13.529762 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d86ee04-d04c-49c4-8079-f490c31d4822 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:13.530717 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d86ee04-d04c-49c4-8079-f490c31d4822 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:13.531319 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d86ee04-d04c-49c4-8079-f490c31d4822 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:13.733199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0d86ee04-d04c-49c4-8079-f490c31d4822 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:13.741246 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0d86ee04-d04c-49c4-8079-f490c31d4822 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1722 microversion: 2.1 time: 0.232633 Aug 30 05:14:13.741841 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 173/354] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:13 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:13.778527 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a898bb3e-0e60-48fa-90fd-b3e35a37c2f0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:13.779170 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a898bb3e-0e60-48fa-90fd-b3e35a37c2f0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:13.786061 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a898bb3e-0e60-48fa-90fd-b3e35a37c2f0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:13.786539 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a898bb3e-0e60-48fa-90fd-b3e35a37c2f0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:13.787016 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a898bb3e-0e60-48fa-90fd-b3e35a37c2f0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:13.787929 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a898bb3e-0e60-48fa-90fd-b3e35a37c2f0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:13.788393 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a898bb3e-0e60-48fa-90fd-b3e35a37c2f0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:13.788880 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a898bb3e-0e60-48fa-90fd-b3e35a37c2f0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:13.935958 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a898bb3e-0e60-48fa-90fd-b3e35a37c2f0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:13.945185 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a898bb3e-0e60-48fa-90fd-b3e35a37c2f0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.170208 Aug 30 05:14:13.945846 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 182/355] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:13 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:14.383444 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a15a001c-0864-4a3f-ac2d-0c0699e332ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:14.383976 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a15a001c-0864-4a3f-ac2d-0c0699e332ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:14.389946 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a15a001c-0864-4a3f-ac2d-0c0699e332ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:14.390617 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a15a001c-0864-4a3f-ac2d-0c0699e332ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:14.391244 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a15a001c-0864-4a3f-ac2d-0c0699e332ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:14.391939 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a15a001c-0864-4a3f-ac2d-0c0699e332ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:14.392396 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a15a001c-0864-4a3f-ac2d-0c0699e332ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:14.392869 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a15a001c-0864-4a3f-ac2d-0c0699e332ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:14.554946 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a15a001c-0864-4a3f-ac2d-0c0699e332ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:14.564649 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a15a001c-0864-4a3f-ac2d-0c0699e332ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:14.566965 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a15a001c-0864-4a3f-ac2d-0c0699e332ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:14.568362 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a15a001c-0864-4a3f-ac2d-0c0699e332ad tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.189138 Aug 30 05:14:14.569128 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 174/356] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:14 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:14.762244 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9b8d999a-997e-4af5-a0a5-4805cf4560a2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:14.762995 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9b8d999a-997e-4af5-a0a5-4805cf4560a2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:14.766064 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:14.770725 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b8d999a-997e-4af5-a0a5-4805cf4560a2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:14.771292 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b8d999a-997e-4af5-a0a5-4805cf4560a2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:14.771734 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b8d999a-997e-4af5-a0a5-4805cf4560a2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:14.772463 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b8d999a-997e-4af5-a0a5-4805cf4560a2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:14.772961 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b8d999a-997e-4af5-a0a5-4805cf4560a2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:14.773343 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9b8d999a-997e-4af5-a0a5-4805cf4560a2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:14.944920 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9b8d999a-997e-4af5-a0a5-4805cf4560a2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:14.961764 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9b8d999a-997e-4af5-a0a5-4805cf4560a2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1722 microversion: 2.1 time: 0.203418 Aug 30 05:14:14.984657 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 183/357] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:14 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:14.989216 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-07a80524-07ec-45d1-ab29-ae7809c6abd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:14.990565 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-07a80524-07ec-45d1-ab29-ae7809c6abd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:15.000838 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07a80524-07ec-45d1-ab29-ae7809c6abd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:15.002188 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07a80524-07ec-45d1-ab29-ae7809c6abd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:15.003143 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07a80524-07ec-45d1-ab29-ae7809c6abd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:15.005054 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07a80524-07ec-45d1-ab29-ae7809c6abd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:15.005746 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07a80524-07ec-45d1-ab29-ae7809c6abd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:15.006707 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-07a80524-07ec-45d1-ab29-ae7809c6abd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:15.219929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-07a80524-07ec-45d1-ab29-ae7809c6abd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:15.244238 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-07a80524-07ec-45d1-ab29-ae7809c6abd7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.278789 Aug 30 05:14:15.244996 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 175/358] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:14 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:15.591316 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d10f2bff-299b-43d2-9731-3b5474012e1e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:15.591919 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d10f2bff-299b-43d2-9731-3b5474012e1e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:15.599842 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d10f2bff-299b-43d2-9731-3b5474012e1e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:15.600521 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d10f2bff-299b-43d2-9731-3b5474012e1e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:15.600958 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d10f2bff-299b-43d2-9731-3b5474012e1e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:15.601946 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d10f2bff-299b-43d2-9731-3b5474012e1e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:15.602658 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d10f2bff-299b-43d2-9731-3b5474012e1e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:15.603268 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d10f2bff-299b-43d2-9731-3b5474012e1e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:15.751818 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d10f2bff-299b-43d2-9731-3b5474012e1e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:15.761298 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d10f2bff-299b-43d2-9731-3b5474012e1e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:15.762993 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d10f2bff-299b-43d2-9731-3b5474012e1e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:15.764371 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d10f2bff-299b-43d2-9731-3b5474012e1e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.176679 Aug 30 05:14:15.765339 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 184/359] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:15 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:15.990620 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-003b5385-c738-406f-894f-f42ee153e160 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:15.991292 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-003b5385-c738-406f-894f-f42ee153e160 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:15.998053 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-003b5385-c738-406f-894f-f42ee153e160 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:15.998543 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-003b5385-c738-406f-894f-f42ee153e160 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:15.999067 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-003b5385-c738-406f-894f-f42ee153e160 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:15.999709 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-003b5385-c738-406f-894f-f42ee153e160 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:16.000165 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-003b5385-c738-406f-894f-f42ee153e160 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:16.000588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-003b5385-c738-406f-894f-f42ee153e160 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:16.139777 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-003b5385-c738-406f-894f-f42ee153e160 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:16.147970 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-003b5385-c738-406f-894f-f42ee153e160 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1722 microversion: 2.1 time: 0.161523 Aug 30 05:14:16.148538 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 176/360] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:15 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:16.265041 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ae4eb989-e895-4710-8e80-f66c2a4abd78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:16.265677 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ae4eb989-e895-4710-8e80-f66c2a4abd78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:16.276048 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae4eb989-e895-4710-8e80-f66c2a4abd78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:16.276770 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae4eb989-e895-4710-8e80-f66c2a4abd78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:16.278687 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae4eb989-e895-4710-8e80-f66c2a4abd78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:16.279970 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae4eb989-e895-4710-8e80-f66c2a4abd78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:16.279970 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae4eb989-e895-4710-8e80-f66c2a4abd78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:16.280587 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae4eb989-e895-4710-8e80-f66c2a4abd78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:16.449149 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ae4eb989-e895-4710-8e80-f66c2a4abd78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:16.458775 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ae4eb989-e895-4710-8e80-f66c2a4abd78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.196687 Aug 30 05:14:16.460120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 185/361] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:16 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:16.789443 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-24c6201d-e15f-461d-9b29-da40430215bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:16.789975 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-24c6201d-e15f-461d-9b29-da40430215bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:16.796044 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24c6201d-e15f-461d-9b29-da40430215bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:16.796523 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24c6201d-e15f-461d-9b29-da40430215bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:16.796954 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24c6201d-e15f-461d-9b29-da40430215bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:16.797641 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24c6201d-e15f-461d-9b29-da40430215bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:16.798092 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24c6201d-e15f-461d-9b29-da40430215bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:16.798517 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24c6201d-e15f-461d-9b29-da40430215bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:16.929343 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-24c6201d-e15f-461d-9b29-da40430215bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:16.938518 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-24c6201d-e15f-461d-9b29-da40430215bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:16.940225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-24c6201d-e15f-461d-9b29-da40430215bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:16.941979 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-24c6201d-e15f-461d-9b29-da40430215bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.156518 Aug 30 05:14:16.942939 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 177/362] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:16 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:14:17.169876 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-46be882a-2404-4e4b-9454-ddcc64a6c0bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:17.170704 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-46be882a-2404-4e4b-9454-ddcc64a6c0bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:17.177415 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46be882a-2404-4e4b-9454-ddcc64a6c0bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:17.178115 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46be882a-2404-4e4b-9454-ddcc64a6c0bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:17.178550 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46be882a-2404-4e4b-9454-ddcc64a6c0bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:17.179320 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46be882a-2404-4e4b-9454-ddcc64a6c0bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:17.179931 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46be882a-2404-4e4b-9454-ddcc64a6c0bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:17.180447 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46be882a-2404-4e4b-9454-ddcc64a6c0bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:17.317277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-46be882a-2404-4e4b-9454-ddcc64a6c0bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:17.326421 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-46be882a-2404-4e4b-9454-ddcc64a6c0bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1722 microversion: 2.1 time: 0.161483 Aug 30 05:14:17.327103 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 186/363] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:17 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:17.483664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e5565573-1ec4-4cfa-8b36-973818ecb228 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:17.484488 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e5565573-1ec4-4cfa-8b36-973818ecb228 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:17.491305 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5565573-1ec4-4cfa-8b36-973818ecb228 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:17.491780 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5565573-1ec4-4cfa-8b36-973818ecb228 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:17.492209 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5565573-1ec4-4cfa-8b36-973818ecb228 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:17.492912 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5565573-1ec4-4cfa-8b36-973818ecb228 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:17.493361 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5565573-1ec4-4cfa-8b36-973818ecb228 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:17.493778 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e5565573-1ec4-4cfa-8b36-973818ecb228 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:17.644424 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e5565573-1ec4-4cfa-8b36-973818ecb228 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:17.656176 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e5565573-1ec4-4cfa-8b36-973818ecb228 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.176222 Aug 30 05:14:17.669109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 178/364] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:17 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:17.965977 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6920ac9c-188c-40d2-9109-f698cee85beb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:17.966616 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6920ac9c-188c-40d2-9109-f698cee85beb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:17.973329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6920ac9c-188c-40d2-9109-f698cee85beb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:17.973764 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6920ac9c-188c-40d2-9109-f698cee85beb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:17.975045 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6920ac9c-188c-40d2-9109-f698cee85beb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:17.976363 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6920ac9c-188c-40d2-9109-f698cee85beb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:17.976561 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6920ac9c-188c-40d2-9109-f698cee85beb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:17.977280 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6920ac9c-188c-40d2-9109-f698cee85beb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:18.139637 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6920ac9c-188c-40d2-9109-f698cee85beb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:18.150627 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6920ac9c-188c-40d2-9109-f698cee85beb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:18.156476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6920ac9c-188c-40d2-9109-f698cee85beb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:18.157800 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6920ac9c-188c-40d2-9109-f698cee85beb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.195917 Aug 30 05:14:18.158551 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 187/365] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:17 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:18.351836 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0c53e287-e0d1-4485-9787-09c804bf82d3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:18.352454 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0c53e287-e0d1-4485-9787-09c804bf82d3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:18.361170 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c53e287-e0d1-4485-9787-09c804bf82d3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:18.361799 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c53e287-e0d1-4485-9787-09c804bf82d3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:18.362245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c53e287-e0d1-4485-9787-09c804bf82d3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:18.363190 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c53e287-e0d1-4485-9787-09c804bf82d3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:18.363658 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c53e287-e0d1-4485-9787-09c804bf82d3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:18.364101 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0c53e287-e0d1-4485-9787-09c804bf82d3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:18.560751 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0c53e287-e0d1-4485-9787-09c804bf82d3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:18.574961 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0c53e287-e0d1-4485-9787-09c804bf82d3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1722 microversion: 2.1 time: 0.228800 Aug 30 05:14:18.587365 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 179/366] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:18 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:18.679352 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-798e4f7c-589f-4e44-bb71-e232e95ad711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:18.680443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-798e4f7c-589f-4e44-bb71-e232e95ad711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:18.692163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-798e4f7c-589f-4e44-bb71-e232e95ad711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:18.692729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-798e4f7c-589f-4e44-bb71-e232e95ad711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:18.693409 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-798e4f7c-589f-4e44-bb71-e232e95ad711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:18.694339 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-798e4f7c-589f-4e44-bb71-e232e95ad711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:18.695006 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-798e4f7c-589f-4e44-bb71-e232e95ad711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:18.695935 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-798e4f7c-589f-4e44-bb71-e232e95ad711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:18.868775 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-798e4f7c-589f-4e44-bb71-e232e95ad711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:18.877976 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-798e4f7c-589f-4e44-bb71-e232e95ad711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.204977 Aug 30 05:14:18.878907 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 188/367] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:18 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:19.186008 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9d8df1a5-af28-4d46-8af1-3ee1347ee961 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:19.186642 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9d8df1a5-af28-4d46-8af1-3ee1347ee961 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:19.194728 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d8df1a5-af28-4d46-8af1-3ee1347ee961 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:19.195273 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d8df1a5-af28-4d46-8af1-3ee1347ee961 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:19.195718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d8df1a5-af28-4d46-8af1-3ee1347ee961 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:19.196477 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d8df1a5-af28-4d46-8af1-3ee1347ee961 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:19.196939 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d8df1a5-af28-4d46-8af1-3ee1347ee961 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:19.197376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d8df1a5-af28-4d46-8af1-3ee1347ee961 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:19.440760 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9d8df1a5-af28-4d46-8af1-3ee1347ee961 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:19.466223 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9d8df1a5-af28-4d46-8af1-3ee1347ee961 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:19.472735 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9d8df1a5-af28-4d46-8af1-3ee1347ee961 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:19.475441 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9d8df1a5-af28-4d46-8af1-3ee1347ee961 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.297748 Aug 30 05:14:19.495575 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 180/368] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:19 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:19.605005 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-65cbad17-6f25-4647-9cd8-6f14a0acdae9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:19.606115 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-65cbad17-6f25-4647-9cd8-6f14a0acdae9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:19.613828 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-65cbad17-6f25-4647-9cd8-6f14a0acdae9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:19.614466 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-65cbad17-6f25-4647-9cd8-6f14a0acdae9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:19.615062 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-65cbad17-6f25-4647-9cd8-6f14a0acdae9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:19.616054 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-65cbad17-6f25-4647-9cd8-6f14a0acdae9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:19.616911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-65cbad17-6f25-4647-9cd8-6f14a0acdae9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:19.617463 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-65cbad17-6f25-4647-9cd8-6f14a0acdae9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:19.806004 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-65cbad17-6f25-4647-9cd8-6f14a0acdae9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:19.822870 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-65cbad17-6f25-4647-9cd8-6f14a0acdae9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1722 microversion: 2.1 time: 0.222210 Aug 30 05:14:19.835984 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 189/369] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:19 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:19.900506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-04a343ff-f891-4bdb-a58d-7aa48897c5dc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:19.901166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-04a343ff-f891-4bdb-a58d-7aa48897c5dc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:19.909780 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04a343ff-f891-4bdb-a58d-7aa48897c5dc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:19.910521 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04a343ff-f891-4bdb-a58d-7aa48897c5dc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:19.911197 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04a343ff-f891-4bdb-a58d-7aa48897c5dc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:19.913611 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04a343ff-f891-4bdb-a58d-7aa48897c5dc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:19.914494 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04a343ff-f891-4bdb-a58d-7aa48897c5dc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:19.915238 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-04a343ff-f891-4bdb-a58d-7aa48897c5dc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:20.073104 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-04a343ff-f891-4bdb-a58d-7aa48897c5dc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:20.081749 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-04a343ff-f891-4bdb-a58d-7aa48897c5dc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.186278 Aug 30 05:14:20.084867 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 181/370] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:19 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:20.506611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5ac284e2-f13b-4e7a-a2ba-6f0cedca0907 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:20.507593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5ac284e2-f13b-4e7a-a2ba-6f0cedca0907 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:20.514180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ac284e2-f13b-4e7a-a2ba-6f0cedca0907 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:20.514667 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ac284e2-f13b-4e7a-a2ba-6f0cedca0907 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:20.515319 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ac284e2-f13b-4e7a-a2ba-6f0cedca0907 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:20.516179 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ac284e2-f13b-4e7a-a2ba-6f0cedca0907 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:20.516660 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ac284e2-f13b-4e7a-a2ba-6f0cedca0907 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:20.517247 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ac284e2-f13b-4e7a-a2ba-6f0cedca0907 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:20.677067 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5ac284e2-f13b-4e7a-a2ba-6f0cedca0907 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:20.686495 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5ac284e2-f13b-4e7a-a2ba-6f0cedca0907 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:20.688252 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5ac284e2-f13b-4e7a-a2ba-6f0cedca0907 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:20.689609 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5ac284e2-f13b-4e7a-a2ba-6f0cedca0907 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.193267 Aug 30 05:14:20.705800 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 190/371] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:20 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:20.847227 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-14ff1c7c-6d30-49e5-a688-500ab38a317a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:20.848124 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-14ff1c7c-6d30-49e5-a688-500ab38a317a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:20.854946 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14ff1c7c-6d30-49e5-a688-500ab38a317a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:20.855544 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14ff1c7c-6d30-49e5-a688-500ab38a317a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:20.856068 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14ff1c7c-6d30-49e5-a688-500ab38a317a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:20.856837 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14ff1c7c-6d30-49e5-a688-500ab38a317a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:20.857368 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14ff1c7c-6d30-49e5-a688-500ab38a317a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:20.857964 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14ff1c7c-6d30-49e5-a688-500ab38a317a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:20.998833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-14ff1c7c-6d30-49e5-a688-500ab38a317a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:21.008460 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-14ff1c7c-6d30-49e5-a688-500ab38a317a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1722 microversion: 2.1 time: 0.166375 Aug 30 05:14:21.009008 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 182/372] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:20 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:21.105309 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e19e3aff-fe85-4bff-942b-5df2298fcf02 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:21.105920 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e19e3aff-fe85-4bff-942b-5df2298fcf02 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:21.111896 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e19e3aff-fe85-4bff-942b-5df2298fcf02 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:21.112380 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e19e3aff-fe85-4bff-942b-5df2298fcf02 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:21.112822 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e19e3aff-fe85-4bff-942b-5df2298fcf02 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:21.113565 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e19e3aff-fe85-4bff-942b-5df2298fcf02 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:21.113988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e19e3aff-fe85-4bff-942b-5df2298fcf02 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:21.114855 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e19e3aff-fe85-4bff-942b-5df2298fcf02 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:21.267686 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e19e3aff-fe85-4bff-942b-5df2298fcf02 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:21.280440 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e19e3aff-fe85-4bff-942b-5df2298fcf02 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.178859 Aug 30 05:14:21.281017 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 191/373] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:21 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:21.713120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fe647b57-9501-4020-a4cb-de6b422f8fa6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:21.713829 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fe647b57-9501-4020-a4cb-de6b422f8fa6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:21.720420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe647b57-9501-4020-a4cb-de6b422f8fa6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:21.720933 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe647b57-9501-4020-a4cb-de6b422f8fa6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:21.721452 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe647b57-9501-4020-a4cb-de6b422f8fa6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:21.722249 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe647b57-9501-4020-a4cb-de6b422f8fa6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:21.723008 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe647b57-9501-4020-a4cb-de6b422f8fa6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:21.723526 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fe647b57-9501-4020-a4cb-de6b422f8fa6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:21.869125 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fe647b57-9501-4020-a4cb-de6b422f8fa6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:21.877936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fe647b57-9501-4020-a4cb-de6b422f8fa6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:21.879460 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fe647b57-9501-4020-a4cb-de6b422f8fa6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:21.881486 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fe647b57-9501-4020-a4cb-de6b422f8fa6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.172804 Aug 30 05:14:21.891894 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 183/374] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:21 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:22.031897 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1658dbc8-8c63-48b4-bdf5-dbad6fc4e4b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:22.032524 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1658dbc8-8c63-48b4-bdf5-dbad6fc4e4b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:22.039378 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1658dbc8-8c63-48b4-bdf5-dbad6fc4e4b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:22.039869 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1658dbc8-8c63-48b4-bdf5-dbad6fc4e4b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:22.040298 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1658dbc8-8c63-48b4-bdf5-dbad6fc4e4b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:22.040978 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1658dbc8-8c63-48b4-bdf5-dbad6fc4e4b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:22.041448 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1658dbc8-8c63-48b4-bdf5-dbad6fc4e4b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:22.041940 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1658dbc8-8c63-48b4-bdf5-dbad6fc4e4b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:22.184256 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1658dbc8-8c63-48b4-bdf5-dbad6fc4e4b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:22.194017 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1658dbc8-8c63-48b4-bdf5-dbad6fc4e4b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1722 microversion: 2.1 time: 0.166605 Aug 30 05:14:22.194584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 192/375] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:22 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:22.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-032c367c-52e4-46a5-99d2-c480937ef0b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:22.306444 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-032c367c-52e4-46a5-99d2-c480937ef0b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:22.317756 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-032c367c-52e4-46a5-99d2-c480937ef0b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:22.318592 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-032c367c-52e4-46a5-99d2-c480937ef0b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:22.320302 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-032c367c-52e4-46a5-99d2-c480937ef0b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:22.322043 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-032c367c-52e4-46a5-99d2-c480937ef0b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:22.324142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-032c367c-52e4-46a5-99d2-c480937ef0b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:22.324669 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-032c367c-52e4-46a5-99d2-c480937ef0b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:22.469697 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-032c367c-52e4-46a5-99d2-c480937ef0b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:22.483075 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-032c367c-52e4-46a5-99d2-c480937ef0b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.182040 Aug 30 05:14:22.484075 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 184/376] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:22 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:22.905350 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a4b86195-a5d0-4cb4-86d6-a4f4a7e0034e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:22.906613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a4b86195-a5d0-4cb4-86d6-a4f4a7e0034e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:22.913777 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4b86195-a5d0-4cb4-86d6-a4f4a7e0034e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:22.914336 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4b86195-a5d0-4cb4-86d6-a4f4a7e0034e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:22.914788 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4b86195-a5d0-4cb4-86d6-a4f4a7e0034e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:22.915831 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4b86195-a5d0-4cb4-86d6-a4f4a7e0034e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:22.916304 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4b86195-a5d0-4cb4-86d6-a4f4a7e0034e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:22.916735 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a4b86195-a5d0-4cb4-86d6-a4f4a7e0034e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.085879 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a4b86195-a5d0-4cb4-86d6-a4f4a7e0034e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:23.093993 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a4b86195-a5d0-4cb4-86d6-a4f4a7e0034e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:23.095451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a4b86195-a5d0-4cb4-86d6-a4f4a7e0034e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:23.096586 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a4b86195-a5d0-4cb4-86d6-a4f4a7e0034e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.195487 Aug 30 05:14:23.097126 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 193/377] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:22 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:23.216616 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-62058f78-a856-4dc1-b303-fbee286cf50c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:23.217260 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-62058f78-a856-4dc1-b303-fbee286cf50c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:23.220795 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=90 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:23.225374 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62058f78-a856-4dc1-b303-fbee286cf50c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.225858 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62058f78-a856-4dc1-b303-fbee286cf50c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.226319 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62058f78-a856-4dc1-b303-fbee286cf50c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.227053 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62058f78-a856-4dc1-b303-fbee286cf50c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.227512 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62058f78-a856-4dc1-b303-fbee286cf50c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.228100 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62058f78-a856-4dc1-b303-fbee286cf50c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.369526 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-62058f78-a856-4dc1-b303-fbee286cf50c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:23.377801 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-62058f78-a856-4dc1-b303-fbee286cf50c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1722 microversion: 2.1 time: 0.165089 Aug 30 05:14:23.378355 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 185/378] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:23 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:23.508982 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8d9af01f-0105-4079-b5f7-55430ed27950 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:23.509603 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8d9af01f-0105-4079-b5f7-55430ed27950 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:23.515775 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d9af01f-0105-4079-b5f7-55430ed27950 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.516256 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d9af01f-0105-4079-b5f7-55430ed27950 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.516731 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d9af01f-0105-4079-b5f7-55430ed27950 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.517403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d9af01f-0105-4079-b5f7-55430ed27950 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.517848 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d9af01f-0105-4079-b5f7-55430ed27950 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.518452 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8d9af01f-0105-4079-b5f7-55430ed27950 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.701743 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8d9af01f-0105-4079-b5f7-55430ed27950 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:23.711856 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8d9af01f-0105-4079-b5f7-55430ed27950 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.206705 Aug 30 05:14:23.712591 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 194/379] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:23 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:24.120351 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a5759306-168c-4c2c-beda-c29a6e559888 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:24.121013 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a5759306-168c-4c2c-beda-c29a6e559888 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:24.131613 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5759306-168c-4c2c-beda-c29a6e559888 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:24.132087 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5759306-168c-4c2c-beda-c29a6e559888 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:24.132527 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5759306-168c-4c2c-beda-c29a6e559888 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:24.133300 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5759306-168c-4c2c-beda-c29a6e559888 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:24.133823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5759306-168c-4c2c-beda-c29a6e559888 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:24.134124 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a5759306-168c-4c2c-beda-c29a6e559888 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:24.181346 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:24.399668 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2b642d54-b043-44e0-8000-828e7c3d9ec6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:24.400666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2b642d54-b043-44e0-8000-828e7c3d9ec6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:24.403236 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a5759306-168c-4c2c-beda-c29a6e559888 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:24.425100 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b642d54-b043-44e0-8000-828e7c3d9ec6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:24.425727 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b642d54-b043-44e0-8000-828e7c3d9ec6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:24.426274 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b642d54-b043-44e0-8000-828e7c3d9ec6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:24.427703 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b642d54-b043-44e0-8000-828e7c3d9ec6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:24.428469 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b642d54-b043-44e0-8000-828e7c3d9ec6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:24.428981 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2b642d54-b043-44e0-8000-828e7c3d9ec6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:24.429534 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a5759306-168c-4c2c-beda-c29a6e559888 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:24.431157 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a5759306-168c-4c2c-beda-c29a6e559888 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:24.432386 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a5759306-168c-4c2c-beda-c29a6e559888 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.316169 Aug 30 05:14:24.432954 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 186/380] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:24 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:14:24.641836 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2b642d54-b043-44e0-8000-828e7c3d9ec6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:24.651530 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2b642d54-b043-44e0-8000-828e7c3d9ec6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1722 microversion: 2.1 time: 0.256637 Aug 30 05:14:24.653016 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 195/381] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:24 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:24.733795 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ab74e00a-e4a6-4d01-9a7e-8662aba69823 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:24.734781 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ab74e00a-e4a6-4d01-9a7e-8662aba69823 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:24.743503 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab74e00a-e4a6-4d01-9a7e-8662aba69823 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:24.744205 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab74e00a-e4a6-4d01-9a7e-8662aba69823 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:24.744832 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab74e00a-e4a6-4d01-9a7e-8662aba69823 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:24.745713 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab74e00a-e4a6-4d01-9a7e-8662aba69823 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:24.746177 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab74e00a-e4a6-4d01-9a7e-8662aba69823 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:24.746610 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ab74e00a-e4a6-4d01-9a7e-8662aba69823 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:24.944256 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ab74e00a-e4a6-4d01-9a7e-8662aba69823 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:24.955941 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ab74e00a-e4a6-4d01-9a7e-8662aba69823 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.223645 Aug 30 05:14:24.970495 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 187/382] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:24 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:25.474781 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ac3aef5d-57d7-4c57-a24a-72671c26deed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:25.478030 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ac3aef5d-57d7-4c57-a24a-72671c26deed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:25.493521 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3aef5d-57d7-4c57-a24a-72671c26deed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:25.497718 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3aef5d-57d7-4c57-a24a-72671c26deed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:25.498359 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3aef5d-57d7-4c57-a24a-72671c26deed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:25.499470 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3aef5d-57d7-4c57-a24a-72671c26deed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:25.502571 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3aef5d-57d7-4c57-a24a-72671c26deed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:25.503047 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac3aef5d-57d7-4c57-a24a-72671c26deed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:25.675225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f6ee79a6-8a2d-4f26-a4f0-2ace7ae5236a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:25.675852 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f6ee79a6-8a2d-4f26-a4f0-2ace7ae5236a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:25.687845 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6ee79a6-8a2d-4f26-a4f0-2ace7ae5236a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:25.688364 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6ee79a6-8a2d-4f26-a4f0-2ace7ae5236a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:25.688807 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6ee79a6-8a2d-4f26-a4f0-2ace7ae5236a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:25.694329 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6ee79a6-8a2d-4f26-a4f0-2ace7ae5236a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:25.695079 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6ee79a6-8a2d-4f26-a4f0-2ace7ae5236a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:25.695699 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6ee79a6-8a2d-4f26-a4f0-2ace7ae5236a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:25.716521 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ac3aef5d-57d7-4c57-a24a-72671c26deed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:25.729840 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ac3aef5d-57d7-4c57-a24a-72671c26deed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:25.732068 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ac3aef5d-57d7-4c57-a24a-72671c26deed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:25.734762 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ac3aef5d-57d7-4c57-a24a-72671c26deed tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1744 microversion: 2.20 time: 0.279176 Aug 30 05:14:25.736009 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 196/383] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:25 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1744 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:25.867939 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f6ee79a6-8a2d-4f26-a4f0-2ace7ae5236a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:25.877801 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f6ee79a6-8a2d-4f26-a4f0-2ace7ae5236a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1722 microversion: 2.1 time: 0.206587 Aug 30 05:14:25.883476 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 188/384] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:25 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:25.976781 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-38b86c58-6073-4050-80cf-37c41341bb6a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:25.977621 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-38b86c58-6073-4050-80cf-37c41341bb6a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:25.984634 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38b86c58-6073-4050-80cf-37c41341bb6a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:25.985328 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38b86c58-6073-4050-80cf-37c41341bb6a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:25.985831 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38b86c58-6073-4050-80cf-37c41341bb6a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:25.986652 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38b86c58-6073-4050-80cf-37c41341bb6a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:25.987333 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38b86c58-6073-4050-80cf-37c41341bb6a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:25.987849 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38b86c58-6073-4050-80cf-37c41341bb6a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:26.028129 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:26.212376 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-38b86c58-6073-4050-80cf-37c41341bb6a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:26.220355 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-38b86c58-6073-4050-80cf-37c41341bb6a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1502 microversion: 2.1 time: 0.247447 Aug 30 05:14:26.220918 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 197/385] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:25 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1502 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:26.243739 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fb57d880-0024-457d-8761-be96a6153198 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39d8ad93-063b-4d6b-8033-281e6f5e04a6"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:26.247508 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fb57d880-0024-457d-8761-be96a6153198 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:26.258947 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb57d880-0024-457d-8761-be96a6153198 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:26.259805 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb57d880-0024-457d-8761-be96a6153198 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:26.260443 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb57d880-0024-457d-8761-be96a6153198 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:26.261434 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb57d880-0024-457d-8761-be96a6153198 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:26.262767 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb57d880-0024-457d-8761-be96a6153198 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:26.263332 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fb57d880-0024-457d-8761-be96a6153198 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:26.292349 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-fb57d880-0024-457d-8761-be96a6153198 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] HTTP exception thrown: Cannot 'attach_volume' instance e0ec17dd-c9e2-4802-86c7-f985a04be891 while it is in vm_state rescued Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fb57d880-0024-457d-8761-be96a6153198 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Request method failure captured: Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: POST /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891/os-volume_attachments HTTP/1.1 Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 74 Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZwmh_DDwRU_BEVybRcQ6moSB8pHRQiYw6M2nPThYf10X2ijKHRbdaToX7zYPI-l6N6xyuqYMKqMjKZm748svv5LhMk4_YqUXJlUw5ALU6ysD7iSFrCxa6aOOZC9I2TnhN2vvAfWp7CNt0MAA0G45_k3r-EKMDgIQuxnO7y2pB0I1EQ Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: d2ce224c162c414c9be681b76801969c Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802004164 Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:14:26.296687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:14:26.298029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/d2ce224c162c414c9be681b76801969c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/d2ce224c162c414c9be681b76801969c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/d2ce224c162c414c9be681b76801969c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_d2ce224c162c414c9be681b76801969c", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:14:26.298029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802004164 Aug 30 05:14:26.298029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: d2ce224c162c414c9be681b76801969c Aug 30 05:14:26.298029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802004164 Aug 30 05:14:26.298029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-ServerRescueNegativeTestJSON-1802004164-project Aug 30 05:14:26.298029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:14:26.298029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:14:26.298029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: 31cc6aa564be4c569e6fa89813cb9329 Aug 30 05:14:26.298029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802004164-project Aug 30 05:14:26.298029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Aug 30 05:14:26.298029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {"volumeAttachment": {"volumeId": "39d8ad93-063b-4d6b-8033-281e6f5e04a6"}} Aug 30 05:14:26.298029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Cannot 'attach_volume' instance e0ec17dd-c9e2-4802-86c7-f985a04be891 while it is in vm_state rescued Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'server_id': 'e0ec17dd-c9e2-4802-86c7-f985a04be891', 'body': {'volumeAttachment': {'volumeId': '39d8ad93-063b-4d6b-8033-281e6f5e04a6'}}} Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e0ec17dd-c9e2-4802-86c7-f985a04be891 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:26.299281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e0ec17dd-c9e2-4802-86c7-f985a04be891 while it is in vm_state rescued Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:26.300968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:26.302897 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:14:26.302897 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:14:26.302897 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e0ec17dd-c9e2-4802-86c7-f985a04be891 while it is in vm_state rescued Aug 30 05:14:26.302897 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:14:26.304186 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fb57d880-0024-457d-8761-be96a6153198 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Returning 409 to user: Cannot 'attach_volume' instance e0ec17dd-c9e2-4802-86c7-f985a04be891 while it is in vm_state rescued {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:26.305212 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fb57d880-0024-457d-8761-be96a6153198 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "POST /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.067612 Aug 30 05:14:26.315599 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-df0fbd61-29db-44ef-b48c-7447bcff3c17 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:26.316332 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-df0fbd61-29db-44ef-b48c-7447bcff3c17 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:26.319926 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 189/386] 10.222.0.77 () {60 vars in 1323 bytes} [Tue Aug 30 05:14:26 2022] POST /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891/os-volume_attachments => generated 152 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 05:14:26.323282 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0fbd61-29db-44ef-b48c-7447bcff3c17 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:26.324700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0fbd61-29db-44ef-b48c-7447bcff3c17 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:26.325344 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0fbd61-29db-44ef-b48c-7447bcff3c17 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:26.326219 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0fbd61-29db-44ef-b48c-7447bcff3c17 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:26.326841 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0fbd61-29db-44ef-b48c-7447bcff3c17 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:26.327419 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df0fbd61-29db-44ef-b48c-7447bcff3c17 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:26.459331 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-df0fbd61-29db-44ef-b48c-7447bcff3c17 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "POST /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891/action" status: 202 len: 0 microversion: 2.1 time: 0.146007 Aug 30 05:14:26.463038 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 198/387] 10.222.0.77 () {60 vars in 1278 bytes} [Tue Aug 30 05:14:26 2022] POST /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:14:26.469412 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-17e12796-d654-42e4-8352-75a9b58be57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:26.470215 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-17e12796-d654-42e4-8352-75a9b58be57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:26.476977 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17e12796-d654-42e4-8352-75a9b58be57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:26.478314 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17e12796-d654-42e4-8352-75a9b58be57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:26.479133 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17e12796-d654-42e4-8352-75a9b58be57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:26.480027 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17e12796-d654-42e4-8352-75a9b58be57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:26.481248 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17e12796-d654-42e4-8352-75a9b58be57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:26.482028 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-17e12796-d654-42e4-8352-75a9b58be57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:26.744335 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-17e12796-d654-42e4-8352-75a9b58be57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:26.753126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-17e12796-d654-42e4-8352-75a9b58be57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1510 microversion: 2.1 time: 0.288647 Aug 30 05:14:26.757285 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 190/388] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:26 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1510 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:26.766154 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2ab448b1-d75b-4524-b773-d30443832d37 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:26.767497 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2ab448b1-d75b-4524-b773-d30443832d37 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:26.778801 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ab448b1-d75b-4524-b773-d30443832d37 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:26.780409 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ab448b1-d75b-4524-b773-d30443832d37 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:26.781061 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ab448b1-d75b-4524-b773-d30443832d37 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:26.782561 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ab448b1-d75b-4524-b773-d30443832d37 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:26.783280 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ab448b1-d75b-4524-b773-d30443832d37 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:26.783933 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ab448b1-d75b-4524-b773-d30443832d37 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:26.899508 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-32145d59-16ff-4a61-b77f-90358ffa343d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:26.900377 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-32145d59-16ff-4a61-b77f-90358ffa343d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:26.915904 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32145d59-16ff-4a61-b77f-90358ffa343d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:26.916394 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32145d59-16ff-4a61-b77f-90358ffa343d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:26.916857 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32145d59-16ff-4a61-b77f-90358ffa343d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:26.917532 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32145d59-16ff-4a61-b77f-90358ffa343d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:26.917983 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32145d59-16ff-4a61-b77f-90358ffa343d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:26.918405 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32145d59-16ff-4a61-b77f-90358ffa343d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:27.021093 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2ab448b1-d75b-4524-b773-d30443832d37 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:27.033636 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2ab448b1-d75b-4524-b773-d30443832d37 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:27.035582 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2ab448b1-d75b-4524-b773-d30443832d37 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:27.038014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2ab448b1-d75b-4524-b773-d30443832d37 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1744 microversion: 2.20 time: 0.278941 Aug 30 05:14:27.051838 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 199/389] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:26 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1744 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:27.478095 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-32145d59-16ff-4a61-b77f-90358ffa343d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:27.486399 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-32145d59-16ff-4a61-b77f-90358ffa343d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1699 microversion: 2.1 time: 0.591254 Aug 30 05:14:27.486998 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 191/390] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:26 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1699 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:27.508708 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-89691ec6-e8bb-478a-bc0b-3f186d230395 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:27.515570 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89691ec6-e8bb-478a-bc0b-3f186d230395 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:27.516326 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89691ec6-e8bb-478a-bc0b-3f186d230395 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:27.516802 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-89691ec6-e8bb-478a-bc0b-3f186d230395 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:27.544392 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-89691ec6-e8bb-478a-bc0b-3f186d230395 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Going to try to start instance {{(pid=120572) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 05:14:27.612700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-89691ec6-e8bb-478a-bc0b-3f186d230395 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "POST /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/action" status: 202 len: 0 microversion: 2.1 time: 0.107709 Aug 30 05:14:27.613311 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 200/391] 10.222.0.77 () {60 vars in 1278 bytes} [Tue Aug 30 05:14:27 2022] POST /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:14:27.622727 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c0e5c559-b195-4c74-ba59-69f024fb926c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:27.623876 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c0e5c559-b195-4c74-ba59-69f024fb926c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:27.630580 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0e5c559-b195-4c74-ba59-69f024fb926c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:27.631458 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0e5c559-b195-4c74-ba59-69f024fb926c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:27.632140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0e5c559-b195-4c74-ba59-69f024fb926c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:27.633294 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0e5c559-b195-4c74-ba59-69f024fb926c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:27.634023 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0e5c559-b195-4c74-ba59-69f024fb926c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:27.634705 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c0e5c559-b195-4c74-ba59-69f024fb926c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:27.778106 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dfb57624-18f9-4866-8741-660244529587 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:27.778809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dfb57624-18f9-4866-8741-660244529587 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:27.783418 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c0e5c559-b195-4c74-ba59-69f024fb926c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:27.792792 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c0e5c559-b195-4c74-ba59-69f024fb926c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1708 microversion: 2.1 time: 0.174554 Aug 30 05:14:27.793770 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 192/392] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:27 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1708 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:27.795894 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfb57624-18f9-4866-8741-660244529587 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:27.799682 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfb57624-18f9-4866-8741-660244529587 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:27.800311 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfb57624-18f9-4866-8741-660244529587 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:27.802374 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfb57624-18f9-4866-8741-660244529587 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:27.803469 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfb57624-18f9-4866-8741-660244529587 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:27.804194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dfb57624-18f9-4866-8741-660244529587 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:27.999351 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dfb57624-18f9-4866-8741-660244529587 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:28.023884 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dfb57624-18f9-4866-8741-660244529587 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1510 microversion: 2.1 time: 0.249788 Aug 30 05:14:28.027846 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 201/393] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:27 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:28.072708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dbb84f61-3425-4515-96c4-2cd7b595cfbe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:28.078643 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dbb84f61-3425-4515-96c4-2cd7b595cfbe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:28.101931 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbb84f61-3425-4515-96c4-2cd7b595cfbe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:28.102437 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbb84f61-3425-4515-96c4-2cd7b595cfbe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:28.102905 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbb84f61-3425-4515-96c4-2cd7b595cfbe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:28.103655 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbb84f61-3425-4515-96c4-2cd7b595cfbe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:28.104437 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbb84f61-3425-4515-96c4-2cd7b595cfbe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:28.104867 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dbb84f61-3425-4515-96c4-2cd7b595cfbe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:28.309928 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dbb84f61-3425-4515-96c4-2cd7b595cfbe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:28.318945 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dbb84f61-3425-4515-96c4-2cd7b595cfbe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:28.325646 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dbb84f61-3425-4515-96c4-2cd7b595cfbe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:28.327804 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dbb84f61-3425-4515-96c4-2cd7b595cfbe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1744 microversion: 2.20 time: 0.270249 Aug 30 05:14:28.328488 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 193/394] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:28 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1744 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:28.340861 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-03b54e9d-9e05-4bb3-badb-7fd08fc5a55d req-422d4603-2a2a-45ad-a823-57295bd316a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f83c589-3a23-45aa-96c5-3cf9006b3830", "name": "network-vif-plugged", "status": "completed", "tag": "c5da19b6-98a0-4af9-b8f5-52291d4a9be0"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:28.363429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-03b54e9d-9e05-4bb3-badb-7fd08fc5a55d req-422d4603-2a2a-45ad-a823-57295bd316a1 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:28.364153 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-03b54e9d-9e05-4bb3-badb-7fd08fc5a55d req-422d4603-2a2a-45ad-a823-57295bd316a1 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:28.365484 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-03b54e9d-9e05-4bb3-badb-7fd08fc5a55d req-422d4603-2a2a-45ad-a823-57295bd316a1 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:28.380832 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-03b54e9d-9e05-4bb3-badb-7fd08fc5a55d req-422d4603-2a2a-45ad-a823-57295bd316a1 service nova] Creating event network-vif-plugged:c5da19b6-98a0-4af9-b8f5-52291d4a9be0 for instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 on hv-cinder-85391 Aug 30 05:14:28.387532 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-03b54e9d-9e05-4bb3-badb-7fd08fc5a55d req-422d4603-2a2a-45ad-a823-57295bd316a1 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062336 Aug 30 05:14:28.389014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 202/395] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:14:28.813934 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-12550b0c-88b4-4a39-88c7-3b19561dcdd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:28.815319 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-12550b0c-88b4-4a39-88c7-3b19561dcdd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:28.822173 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12550b0c-88b4-4a39-88c7-3b19561dcdd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:28.822739 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12550b0c-88b4-4a39-88c7-3b19561dcdd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:28.823280 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12550b0c-88b4-4a39-88c7-3b19561dcdd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:28.824043 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12550b0c-88b4-4a39-88c7-3b19561dcdd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:28.824758 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12550b0c-88b4-4a39-88c7-3b19561dcdd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:28.825423 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-12550b0c-88b4-4a39-88c7-3b19561dcdd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:28.968867 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-12550b0c-88b4-4a39-88c7-3b19561dcdd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:28.979321 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-12550b0c-88b4-4a39-88c7-3b19561dcdd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1708 microversion: 2.1 time: 0.169039 Aug 30 05:14:28.980288 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 194/396] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:28 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1708 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:29.061666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9ad34274-4fd9-4769-96a6-eaa27106b8cd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:29.062363 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9ad34274-4fd9-4769-96a6-eaa27106b8cd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:29.069721 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ad34274-4fd9-4769-96a6-eaa27106b8cd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:29.070223 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ad34274-4fd9-4769-96a6-eaa27106b8cd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:29.070856 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ad34274-4fd9-4769-96a6-eaa27106b8cd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:29.071701 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ad34274-4fd9-4769-96a6-eaa27106b8cd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:29.072312 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ad34274-4fd9-4769-96a6-eaa27106b8cd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:29.072976 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9ad34274-4fd9-4769-96a6-eaa27106b8cd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:29.214460 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9ad34274-4fd9-4769-96a6-eaa27106b8cd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:29.222462 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9ad34274-4fd9-4769-96a6-eaa27106b8cd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1510 microversion: 2.1 time: 0.164947 Aug 30 05:14:29.223057 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 203/397] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:29 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:29.245796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bbecbd2d-bff6-40ef-89dc-8259594821af tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c59a5b9d-d8fb-4812-828b-1b6719061411", "device": "/dev/sdb"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:29.248767 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bbecbd2d-bff6-40ef-89dc-8259594821af tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:29.255481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbecbd2d-bff6-40ef-89dc-8259594821af tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:29.255989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbecbd2d-bff6-40ef-89dc-8259594821af tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:29.256403 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbecbd2d-bff6-40ef-89dc-8259594821af tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:29.257142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbecbd2d-bff6-40ef-89dc-8259594821af tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:29.257592 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbecbd2d-bff6-40ef-89dc-8259594821af tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:29.258269 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbecbd2d-bff6-40ef-89dc-8259594821af tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:29.353944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-71bab8c5-0ff7-46af-8ab7-a9a8eaf4d817 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:29.354553 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-71bab8c5-0ff7-46af-8ab7-a9a8eaf4d817 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:29.360373 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71bab8c5-0ff7-46af-8ab7-a9a8eaf4d817 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:29.360856 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71bab8c5-0ff7-46af-8ab7-a9a8eaf4d817 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:29.361290 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71bab8c5-0ff7-46af-8ab7-a9a8eaf4d817 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:29.361967 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71bab8c5-0ff7-46af-8ab7-a9a8eaf4d817 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:29.362421 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71bab8c5-0ff7-46af-8ab7-a9a8eaf4d817 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:29.362864 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-71bab8c5-0ff7-46af-8ab7-a9a8eaf4d817 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:29.488551 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-71bab8c5-0ff7-46af-8ab7-a9a8eaf4d817 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:29.496525 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-71bab8c5-0ff7-46af-8ab7-a9a8eaf4d817 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:29.497967 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-71bab8c5-0ff7-46af-8ab7-a9a8eaf4d817 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:29.499141 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-71bab8c5-0ff7-46af-8ab7-a9a8eaf4d817 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1744 microversion: 2.20 time: 0.149019 Aug 30 05:14:29.499693 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 204/398] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:29 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:14:30.001996 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6fcda876-e0cd-41fe-9fd1-4df7fd9a5cb0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:30.002598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6fcda876-e0cd-41fe-9fd1-4df7fd9a5cb0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:30.009122 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6fcda876-e0cd-41fe-9fd1-4df7fd9a5cb0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:30.009597 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6fcda876-e0cd-41fe-9fd1-4df7fd9a5cb0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:30.010024 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6fcda876-e0cd-41fe-9fd1-4df7fd9a5cb0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:30.010700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6fcda876-e0cd-41fe-9fd1-4df7fd9a5cb0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:30.011173 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6fcda876-e0cd-41fe-9fd1-4df7fd9a5cb0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:30.011593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6fcda876-e0cd-41fe-9fd1-4df7fd9a5cb0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:30.141298 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6fcda876-e0cd-41fe-9fd1-4df7fd9a5cb0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:30.149421 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6fcda876-e0cd-41fe-9fd1-4df7fd9a5cb0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1708 microversion: 2.1 time: 0.151225 Aug 30 05:14:30.149984 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 205/399] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:29 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1708 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:30.244705 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-46da0c97-e026-470b-a037-7737951f88f4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:30.245935 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-46da0c97-e026-470b-a037-7737951f88f4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:30.251824 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46da0c97-e026-470b-a037-7737951f88f4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:30.252306 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46da0c97-e026-470b-a037-7737951f88f4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:30.252738 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46da0c97-e026-470b-a037-7737951f88f4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:30.253421 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46da0c97-e026-470b-a037-7737951f88f4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:30.253878 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46da0c97-e026-470b-a037-7737951f88f4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:30.254331 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46da0c97-e026-470b-a037-7737951f88f4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:30.380298 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-46da0c97-e026-470b-a037-7737951f88f4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:30.387936 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-46da0c97-e026-470b-a037-7737951f88f4 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1510 microversion: 2.1 time: 0.146905 Aug 30 05:14:30.388500 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 206/400] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:30 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:30.521508 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-73583833-b25f-40ee-871f-ed10611644bd tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:30.522256 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-73583833-b25f-40ee-871f-ed10611644bd tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:30.528439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73583833-b25f-40ee-871f-ed10611644bd tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:30.528922 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73583833-b25f-40ee-871f-ed10611644bd tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:30.529359 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73583833-b25f-40ee-871f-ed10611644bd tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:30.530045 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73583833-b25f-40ee-871f-ed10611644bd tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:30.530499 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73583833-b25f-40ee-871f-ed10611644bd tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:30.530957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-73583833-b25f-40ee-871f-ed10611644bd tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:30.655730 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-73583833-b25f-40ee-871f-ed10611644bd tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:30.664247 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-73583833-b25f-40ee-871f-ed10611644bd tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:30.665681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-73583833-b25f-40ee-871f-ed10611644bd tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:30.666840 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-73583833-b25f-40ee-871f-ed10611644bd tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1744 microversion: 2.20 time: 0.149311 Aug 30 05:14:30.667401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 207/401] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:30 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:14:31.169519 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-47a44a1f-0e89-4ddb-a633-d49d58df3ab0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:31.170134 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-47a44a1f-0e89-4ddb-a633-d49d58df3ab0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:31.176281 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47a44a1f-0e89-4ddb-a633-d49d58df3ab0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:31.176768 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47a44a1f-0e89-4ddb-a633-d49d58df3ab0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:31.177209 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47a44a1f-0e89-4ddb-a633-d49d58df3ab0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:31.177899 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47a44a1f-0e89-4ddb-a633-d49d58df3ab0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:31.178354 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47a44a1f-0e89-4ddb-a633-d49d58df3ab0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:31.178779 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-47a44a1f-0e89-4ddb-a633-d49d58df3ab0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:31.306597 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-47a44a1f-0e89-4ddb-a633-d49d58df3ab0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:31.314625 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-47a44a1f-0e89-4ddb-a633-d49d58df3ab0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1708 microversion: 2.1 time: 0.149014 Aug 30 05:14:31.315224 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 208/402] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:31 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1708 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:31.408222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0cca2e43-5e59-4dab-8027-cbb7ebd633c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:31.408853 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0cca2e43-5e59-4dab-8027-cbb7ebd633c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:31.414588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0cca2e43-5e59-4dab-8027-cbb7ebd633c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:31.415101 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0cca2e43-5e59-4dab-8027-cbb7ebd633c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:31.415529 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0cca2e43-5e59-4dab-8027-cbb7ebd633c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:31.416202 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0cca2e43-5e59-4dab-8027-cbb7ebd633c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:31.416650 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0cca2e43-5e59-4dab-8027-cbb7ebd633c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:31.417074 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0cca2e43-5e59-4dab-8027-cbb7ebd633c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:31.543749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0cca2e43-5e59-4dab-8027-cbb7ebd633c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:31.551395 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0cca2e43-5e59-4dab-8027-cbb7ebd633c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1510 microversion: 2.1 time: 0.146849 Aug 30 05:14:31.552454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 209/403] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:31 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:31.689734 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-93975a6a-9fcb-435d-b6d8-6780c96e44ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:31.690308 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-93975a6a-9fcb-435d-b6d8-6780c96e44ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:31.696763 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93975a6a-9fcb-435d-b6d8-6780c96e44ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:31.697240 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93975a6a-9fcb-435d-b6d8-6780c96e44ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:31.697674 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93975a6a-9fcb-435d-b6d8-6780c96e44ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:31.698354 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93975a6a-9fcb-435d-b6d8-6780c96e44ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:31.698839 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93975a6a-9fcb-435d-b6d8-6780c96e44ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:31.699263 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-93975a6a-9fcb-435d-b6d8-6780c96e44ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:31.825998 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-93975a6a-9fcb-435d-b6d8-6780c96e44ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:31.834029 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-93975a6a-9fcb-435d-b6d8-6780c96e44ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:31.835540 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-93975a6a-9fcb-435d-b6d8-6780c96e44ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:31.836693 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-93975a6a-9fcb-435d-b6d8-6780c96e44ef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1744 microversion: 2.20 time: 0.150879 Aug 30 05:14:31.837247 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 210/404] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:31 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:14:32.336383 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1587862a-4774-4201-9008-237ca7b26e12 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:32.337034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1587862a-4774-4201-9008-237ca7b26e12 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:32.342981 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1587862a-4774-4201-9008-237ca7b26e12 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:32.343716 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1587862a-4774-4201-9008-237ca7b26e12 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:32.344147 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1587862a-4774-4201-9008-237ca7b26e12 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:32.344830 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1587862a-4774-4201-9008-237ca7b26e12 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:32.345283 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1587862a-4774-4201-9008-237ca7b26e12 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:32.345706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1587862a-4774-4201-9008-237ca7b26e12 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:32.486550 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1587862a-4774-4201-9008-237ca7b26e12 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:32.495572 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1587862a-4774-4201-9008-237ca7b26e12 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1708 microversion: 2.1 time: 0.163182 Aug 30 05:14:32.496247 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 211/405] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:32 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1708 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:32.573697 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-55eddd56-7677-4895-b798-7a25490d159f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:32.574498 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-55eddd56-7677-4895-b798-7a25490d159f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:32.583814 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55eddd56-7677-4895-b798-7a25490d159f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:32.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55eddd56-7677-4895-b798-7a25490d159f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:32.584886 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55eddd56-7677-4895-b798-7a25490d159f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:32.585933 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55eddd56-7677-4895-b798-7a25490d159f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:32.587040 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55eddd56-7677-4895-b798-7a25490d159f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:32.587455 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-55eddd56-7677-4895-b798-7a25490d159f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:32.728279 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bbecbd2d-bff6-40ef-89dc-8259594821af tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "POST /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.486209 Aug 30 05:14:32.729267 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 195/406] 10.222.0.77 () {60 vars in 1323 bytes} [Tue Aug 30 05:14:29 2022] POST /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b/os-volume_attachments => generated 194 bytes in 3488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:14:32.740842 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-55eddd56-7677-4895-b798-7a25490d159f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:32.745466 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:32.751632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-55eddd56-7677-4895-b798-7a25490d159f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1510 microversion: 2.1 time: 0.182330 Aug 30 05:14:32.753010 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 212/407] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:32 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:32.860510 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3a551aca-288b-4136-9d22-9e80fa9a9368 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:32.861133 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3a551aca-288b-4136-9d22-9e80fa9a9368 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:32.867703 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a551aca-288b-4136-9d22-9e80fa9a9368 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:32.868183 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a551aca-288b-4136-9d22-9e80fa9a9368 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:32.868615 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a551aca-288b-4136-9d22-9e80fa9a9368 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:32.869300 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a551aca-288b-4136-9d22-9e80fa9a9368 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:32.869751 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a551aca-288b-4136-9d22-9e80fa9a9368 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:32.870203 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3a551aca-288b-4136-9d22-9e80fa9a9368 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:33.000358 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3a551aca-288b-4136-9d22-9e80fa9a9368 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:33.009273 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3a551aca-288b-4136-9d22-9e80fa9a9368 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:33.010726 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3a551aca-288b-4136-9d22-9e80fa9a9368 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:33.011912 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3a551aca-288b-4136-9d22-9e80fa9a9368 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1739 microversion: 2.20 time: 0.155713 Aug 30 05:14:33.012457 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 196/408] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:32 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:14:33.517054 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2ae6fe2c-f549-4d09-af84-6c98fe760c0b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:33.517664 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2ae6fe2c-f549-4d09-af84-6c98fe760c0b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:33.524441 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ae6fe2c-f549-4d09-af84-6c98fe760c0b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:33.525026 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ae6fe2c-f549-4d09-af84-6c98fe760c0b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:33.525467 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ae6fe2c-f549-4d09-af84-6c98fe760c0b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:33.526279 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ae6fe2c-f549-4d09-af84-6c98fe760c0b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:33.527068 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ae6fe2c-f549-4d09-af84-6c98fe760c0b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:33.527498 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ae6fe2c-f549-4d09-af84-6c98fe760c0b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:33.669989 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2ae6fe2c-f549-4d09-af84-6c98fe760c0b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:33.678671 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2ae6fe2c-f549-4d09-af84-6c98fe760c0b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1708 microversion: 2.1 time: 0.165823 Aug 30 05:14:33.679253 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 213/409] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:33 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:33.774266 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-920a07f1-2f5b-497e-a4e3-a08fb1e87f70 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:33.774899 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-920a07f1-2f5b-497e-a4e3-a08fb1e87f70 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:33.781190 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-920a07f1-2f5b-497e-a4e3-a08fb1e87f70 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:33.781668 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-920a07f1-2f5b-497e-a4e3-a08fb1e87f70 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:33.782098 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-920a07f1-2f5b-497e-a4e3-a08fb1e87f70 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:33.782782 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-920a07f1-2f5b-497e-a4e3-a08fb1e87f70 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:33.783258 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-920a07f1-2f5b-497e-a4e3-a08fb1e87f70 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:33.783707 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-920a07f1-2f5b-497e-a4e3-a08fb1e87f70 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:33.908678 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-920a07f1-2f5b-497e-a4e3-a08fb1e87f70 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:33.916794 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-920a07f1-2f5b-497e-a4e3-a08fb1e87f70 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1510 microversion: 2.1 time: 0.146866 Aug 30 05:14:33.917353 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 197/410] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:33 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:34.034981 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-351c5795-989e-47a6-8a66-65a7dc5de73c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:34.035592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-351c5795-989e-47a6-8a66-65a7dc5de73c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:34.042263 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-351c5795-989e-47a6-8a66-65a7dc5de73c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:34.042743 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-351c5795-989e-47a6-8a66-65a7dc5de73c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:34.043278 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-351c5795-989e-47a6-8a66-65a7dc5de73c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:34.043964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-351c5795-989e-47a6-8a66-65a7dc5de73c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:34.044416 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-351c5795-989e-47a6-8a66-65a7dc5de73c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:34.044838 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-351c5795-989e-47a6-8a66-65a7dc5de73c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:34.170529 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-351c5795-989e-47a6-8a66-65a7dc5de73c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:34.178644 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-351c5795-989e-47a6-8a66-65a7dc5de73c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:34.180107 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-351c5795-989e-47a6-8a66-65a7dc5de73c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:34.181261 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-351c5795-989e-47a6-8a66-65a7dc5de73c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1739 microversion: 2.20 time: 0.150300 Aug 30 05:14:34.181987 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 214/411] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:34 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:34.699550 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f66d19d7-5539-49f2-a505-0c062eaf2059 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:34.700168 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f66d19d7-5539-49f2-a505-0c062eaf2059 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:34.706442 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f66d19d7-5539-49f2-a505-0c062eaf2059 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:34.707091 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f66d19d7-5539-49f2-a505-0c062eaf2059 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:34.707538 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f66d19d7-5539-49f2-a505-0c062eaf2059 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:34.708232 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f66d19d7-5539-49f2-a505-0c062eaf2059 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:34.709297 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f66d19d7-5539-49f2-a505-0c062eaf2059 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:34.709735 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f66d19d7-5539-49f2-a505-0c062eaf2059 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:34.839813 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f66d19d7-5539-49f2-a505-0c062eaf2059 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:34.848339 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f66d19d7-5539-49f2-a505-0c062eaf2059 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1708 microversion: 2.1 time: 0.152926 Aug 30 05:14:34.849389 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 198/412] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:34 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1708 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:34.936847 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-43b88f3d-cccb-4eac-bed7-8c54ad09a689 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:34.937455 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-43b88f3d-cccb-4eac-bed7-8c54ad09a689 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:34.943695 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43b88f3d-cccb-4eac-bed7-8c54ad09a689 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:34.944168 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43b88f3d-cccb-4eac-bed7-8c54ad09a689 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:34.944596 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43b88f3d-cccb-4eac-bed7-8c54ad09a689 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:34.945276 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43b88f3d-cccb-4eac-bed7-8c54ad09a689 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:34.945725 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43b88f3d-cccb-4eac-bed7-8c54ad09a689 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:34.946145 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43b88f3d-cccb-4eac-bed7-8c54ad09a689 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:35.078019 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-43b88f3d-cccb-4eac-bed7-8c54ad09a689 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:35.085631 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-43b88f3d-cccb-4eac-bed7-8c54ad09a689 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1510 microversion: 2.1 time: 0.152613 Aug 30 05:14:35.086207 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 215/413] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:34 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:35.204073 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d2afa576-6c96-40eb-acb1-590928d2aa09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:35.204692 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d2afa576-6c96-40eb-acb1-590928d2aa09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:35.210728 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2afa576-6c96-40eb-acb1-590928d2aa09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:35.211242 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2afa576-6c96-40eb-acb1-590928d2aa09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:35.211680 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2afa576-6c96-40eb-acb1-590928d2aa09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:35.212370 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2afa576-6c96-40eb-acb1-590928d2aa09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:35.212826 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2afa576-6c96-40eb-acb1-590928d2aa09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:35.213251 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d2afa576-6c96-40eb-acb1-590928d2aa09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:35.338088 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d2afa576-6c96-40eb-acb1-590928d2aa09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:35.346279 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d2afa576-6c96-40eb-acb1-590928d2aa09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:35.347760 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d2afa576-6c96-40eb-acb1-590928d2aa09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:35.349498 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d2afa576-6c96-40eb-acb1-590928d2aa09 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1739 microversion: 2.20 time: 0.149324 Aug 30 05:14:35.350052 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 199/414] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:35 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1739 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:35.870994 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a64e7e20-6ba5-4509-b962-924ce2674e1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:35.871810 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a64e7e20-6ba5-4509-b962-924ce2674e1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:35.877884 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a64e7e20-6ba5-4509-b962-924ce2674e1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:35.878426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a64e7e20-6ba5-4509-b962-924ce2674e1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:35.878833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a64e7e20-6ba5-4509-b962-924ce2674e1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:35.880144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a64e7e20-6ba5-4509-b962-924ce2674e1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:35.880639 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a64e7e20-6ba5-4509-b962-924ce2674e1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:35.881244 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a64e7e20-6ba5-4509-b962-924ce2674e1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:36.069504 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a64e7e20-6ba5-4509-b962-924ce2674e1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:36.083503 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a64e7e20-6ba5-4509-b962-924ce2674e1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1708 microversion: 2.1 time: 0.217574 Aug 30 05:14:36.084089 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 216/415] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:35 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1708 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:36.108190 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-41d7cf22-622c-48df-b551-8e26d53b2012 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:36.108910 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-41d7cf22-622c-48df-b551-8e26d53b2012 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:36.116790 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41d7cf22-622c-48df-b551-8e26d53b2012 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:36.117399 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41d7cf22-622c-48df-b551-8e26d53b2012 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:36.117929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41d7cf22-622c-48df-b551-8e26d53b2012 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:36.118702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41d7cf22-622c-48df-b551-8e26d53b2012 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:36.119298 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41d7cf22-622c-48df-b551-8e26d53b2012 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:36.119793 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-41d7cf22-622c-48df-b551-8e26d53b2012 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:36.253097 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-41d7cf22-622c-48df-b551-8e26d53b2012 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:36.261424 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-41d7cf22-622c-48df-b551-8e26d53b2012 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1516 microversion: 2.1 time: 0.157150 Aug 30 05:14:36.262011 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 200/416] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:36 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:36.373701 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ad296d25-83b4-4114-8c5f-c8acd5ede93b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:36.374585 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ad296d25-83b4-4114-8c5f-c8acd5ede93b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:36.381041 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad296d25-83b4-4114-8c5f-c8acd5ede93b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:36.381665 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad296d25-83b4-4114-8c5f-c8acd5ede93b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:36.382172 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad296d25-83b4-4114-8c5f-c8acd5ede93b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:36.382988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad296d25-83b4-4114-8c5f-c8acd5ede93b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:36.383666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad296d25-83b4-4114-8c5f-c8acd5ede93b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:36.384161 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad296d25-83b4-4114-8c5f-c8acd5ede93b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:36.555157 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ad296d25-83b4-4114-8c5f-c8acd5ede93b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:36.563489 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ad296d25-83b4-4114-8c5f-c8acd5ede93b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:36.569206 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ad296d25-83b4-4114-8c5f-c8acd5ede93b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:36.571315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ad296d25-83b4-4114-8c5f-c8acd5ede93b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1739 microversion: 2.20 time: 0.201687 Aug 30 05:14:36.578877 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 217/417] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:36 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:37.105515 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-910df5f0-7074-4263-a676-12f4513333fb tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:37.106551 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-910df5f0-7074-4263-a676-12f4513333fb tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:37.113238 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-910df5f0-7074-4263-a676-12f4513333fb tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:37.114764 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-910df5f0-7074-4263-a676-12f4513333fb tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:37.115461 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-910df5f0-7074-4263-a676-12f4513333fb tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:37.116411 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-910df5f0-7074-4263-a676-12f4513333fb tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:37.116952 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-910df5f0-7074-4263-a676-12f4513333fb tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:37.117448 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-910df5f0-7074-4263-a676-12f4513333fb tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:37.294592 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-910df5f0-7074-4263-a676-12f4513333fb tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:37.300958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:37.308381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-910df5f0-7074-4263-a676-12f4513333fb tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1712 microversion: 2.1 time: 0.207238 Aug 30 05:14:37.309784 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 201/418] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:37 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1712 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:37.601251 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-70fefc46-d22e-4dc3-8441-83709912d934 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:37.604760 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-70fefc46-d22e-4dc3-8441-83709912d934 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:37.616864 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70fefc46-d22e-4dc3-8441-83709912d934 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:37.617842 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70fefc46-d22e-4dc3-8441-83709912d934 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:37.618504 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70fefc46-d22e-4dc3-8441-83709912d934 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:37.621877 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70fefc46-d22e-4dc3-8441-83709912d934 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:37.622951 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70fefc46-d22e-4dc3-8441-83709912d934 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:37.624140 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70fefc46-d22e-4dc3-8441-83709912d934 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:37.699623 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4077c762-0583-4fb8-8d97-9afd3638d2cc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Action: 'create', calling method: .version_select at 0x7f822eebd430>, body: {"keypair": {"name": "tempest-keypair-1208478708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGP7djGOlUdCJ35ZSQyorseLESwkVlWN0k4mkmUUdMDuMM/bCZiD7dqnDTOag/YRl4Sc73abKmPrdXEiQF03Rf5ngle4u+7pFMwe30od3YOhW3xL9rI5zghfRBSALOtyaQ=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:37.722109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-4077c762-0583-4fb8-8d97-9afd3638d2cc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Getting quotas for project d2ce224c162c414c9be681b76801969c. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:14:37.729070 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-4077c762-0583-4fb8-8d97-9afd3638d2cc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Getting quotas for user 31cc6aa564be4c569e6fa89813cb9329 and project d2ce224c162c414c9be681b76801969c. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:14:37.761677 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4077c762-0583-4fb8-8d97-9afd3638d2cc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066048 Aug 30 05:14:37.763767 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 202/419] 10.222.0.77 () {60 vars in 1159 bytes} [Tue Aug 30 05:14:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:14:37.849606 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-70fefc46-d22e-4dc3-8441-83709912d934 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:37.864367 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-70fefc46-d22e-4dc3-8441-83709912d934 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:37.867714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-70fefc46-d22e-4dc3-8441-83709912d934 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:37.870840 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-70fefc46-d22e-4dc3-8441-83709912d934 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1739 microversion: 2.20 time: 0.274504 Aug 30 05:14:37.886951 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 218/420] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:37 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:38.898623 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-49d7f1c6-22e5-4135-9d4c-92aca2e225c8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:38.899995 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-49d7f1c6-22e5-4135-9d4c-92aca2e225c8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:38.910172 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d7f1c6-22e5-4135-9d4c-92aca2e225c8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:38.912741 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d7f1c6-22e5-4135-9d4c-92aca2e225c8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:38.913573 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d7f1c6-22e5-4135-9d4c-92aca2e225c8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:38.916070 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d7f1c6-22e5-4135-9d4c-92aca2e225c8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:38.916750 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d7f1c6-22e5-4135-9d4c-92aca2e225c8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:38.918838 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d7f1c6-22e5-4135-9d4c-92aca2e225c8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:39.156300 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-49d7f1c6-22e5-4135-9d4c-92aca2e225c8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:39.168691 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-49d7f1c6-22e5-4135-9d4c-92aca2e225c8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:39.170692 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-49d7f1c6-22e5-4135-9d4c-92aca2e225c8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:39.173779 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-49d7f1c6-22e5-4135-9d4c-92aca2e225c8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1739 microversion: 2.20 time: 0.278042 Aug 30 05:14:39.174759 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 203/421] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:38 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1739 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:39.846455 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-778869268", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16c6adbd-c68c-4f67-83ee-76b6653a3867"}], "security_groups": [{"name": "tempest-securitygroup--1186289656"}], "key_name": "tempest-keypair-1208478708", "user_data": "}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:39.992475 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] validate_networks() for [('16c6adbd-c68c-4f67-83ee-76b6653a3867', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:14:40.197787 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5c03d8f7-ec20-4616-915c-d37dfd86f804 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:40.198618 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5c03d8f7-ec20-4616-915c-d37dfd86f804 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:40.206081 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c03d8f7-ec20-4616-915c-d37dfd86f804 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:40.207123 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c03d8f7-ec20-4616-915c-d37dfd86f804 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:40.207755 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c03d8f7-ec20-4616-915c-d37dfd86f804 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:40.208837 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c03d8f7-ec20-4616-915c-d37dfd86f804 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:40.209881 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c03d8f7-ec20-4616-915c-d37dfd86f804 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:40.210547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5c03d8f7-ec20-4616-915c-d37dfd86f804 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:40.529378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5c03d8f7-ec20-4616-915c-d37dfd86f804 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:40.538573 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5c03d8f7-ec20-4616-915c-d37dfd86f804 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:40.541537 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5c03d8f7-ec20-4616-915c-d37dfd86f804 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:40.543023 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5c03d8f7-ec20-4616-915c-d37dfd86f804 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1739 microversion: 2.20 time: 0.349611 Aug 30 05:14:40.544155 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 204/422] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:40 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1739 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:14:40.787526 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:14:40.788323 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:14:40.788948 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:14:40.789529 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:14:40.790060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:14:40.813465 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:40.813981 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:40.814442 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:40.815251 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:40.815716 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:40.816150 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:40.857195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Getting quotas for project d2ce224c162c414c9be681b76801969c. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:14:40.862237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Getting quotas for user 31cc6aa564be4c569e6fa89813cb9329 and project d2ce224c162c414c9be681b76801969c. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:14:40.884285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:14:40.886918 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:14:40.987280 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c8fd6bc3-4514-4ce0-8477-5496bc8d599d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.145375 Aug 30 05:14:40.988721 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 219/423] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:14:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:14:41.000916 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0600f3d8-93bc-42ab-8f3d-e8e1885c4d4c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:41.001564 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0600f3d8-93bc-42ab-8f3d-e8e1885c4d4c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:41.113557 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0600f3d8-93bc-42ab-8f3d-e8e1885c4d4c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:41.124031 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0600f3d8-93bc-42ab-8f3d-e8e1885c4d4c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1245 microversion: 2.1 time: 0.127035 Aug 30 05:14:41.125018 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 205/424] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:40 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1245 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:41.581854 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f57b8b33-f2ec-4821-bb3f-b2f840f10148 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:41.582509 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f57b8b33-f2ec-4821-bb3f-b2f840f10148 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:41.613247 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f57b8b33-f2ec-4821-bb3f-b2f840f10148 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:41.616165 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f57b8b33-f2ec-4821-bb3f-b2f840f10148 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:41.616737 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f57b8b33-f2ec-4821-bb3f-b2f840f10148 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:41.619916 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f57b8b33-f2ec-4821-bb3f-b2f840f10148 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:41.625288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f57b8b33-f2ec-4821-bb3f-b2f840f10148 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:41.630840 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f57b8b33-f2ec-4821-bb3f-b2f840f10148 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:42.073187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f57b8b33-f2ec-4821-bb3f-b2f840f10148 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:42.089899 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f57b8b33-f2ec-4821-bb3f-b2f840f10148 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:42.096436 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f57b8b33-f2ec-4821-bb3f-b2f840f10148 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:42.100920 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f57b8b33-f2ec-4821-bb3f-b2f840f10148 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1739 microversion: 2.20 time: 0.532418 Aug 30 05:14:42.120455 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 220/425] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:41 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1739 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:42.148306 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-103ee483-d091-4be5-8de7-4b5fe893f5da tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:42.149381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-103ee483-d091-4be5-8de7-4b5fe893f5da tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:42.158378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-103ee483-d091-4be5-8de7-4b5fe893f5da tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:42.159615 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-103ee483-d091-4be5-8de7-4b5fe893f5da tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:42.160242 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-103ee483-d091-4be5-8de7-4b5fe893f5da tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:42.161853 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-103ee483-d091-4be5-8de7-4b5fe893f5da tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:42.164333 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-103ee483-d091-4be5-8de7-4b5fe893f5da tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:42.167687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-103ee483-d091-4be5-8de7-4b5fe893f5da tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:42.282509 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-103ee483-d091-4be5-8de7-4b5fe893f5da tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:42.298511 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-103ee483-d091-4be5-8de7-4b5fe893f5da tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1249 microversion: 2.1 time: 0.158332 Aug 30 05:14:42.311326 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 206/426] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:42 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1249 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:43.132641 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bb492607-f479-4a66-81d4-677e48f04749 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:43.133900 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bb492607-f479-4a66-81d4-677e48f04749 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:43.142863 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb492607-f479-4a66-81d4-677e48f04749 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:43.143717 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb492607-f479-4a66-81d4-677e48f04749 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:43.144376 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb492607-f479-4a66-81d4-677e48f04749 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:43.145946 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb492607-f479-4a66-81d4-677e48f04749 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:43.146640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb492607-f479-4a66-81d4-677e48f04749 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:43.147337 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bb492607-f479-4a66-81d4-677e48f04749 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:43.324833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-072ce539-a90f-4453-826d-fb9d606aa5c9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:43.325446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-072ce539-a90f-4453-826d-fb9d606aa5c9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:43.339602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-072ce539-a90f-4453-826d-fb9d606aa5c9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:43.344291 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-072ce539-a90f-4453-826d-fb9d606aa5c9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:43.345088 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-072ce539-a90f-4453-826d-fb9d606aa5c9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:43.346009 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-072ce539-a90f-4453-826d-fb9d606aa5c9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:43.346662 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-072ce539-a90f-4453-826d-fb9d606aa5c9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:43.347769 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-072ce539-a90f-4453-826d-fb9d606aa5c9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:43.477038 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bb492607-f479-4a66-81d4-677e48f04749 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:43.499898 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bb492607-f479-4a66-81d4-677e48f04749 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:43.501880 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bb492607-f479-4a66-81d4-677e48f04749 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:43.503570 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bb492607-f479-4a66-81d4-677e48f04749 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1739 microversion: 2.20 time: 0.379352 Aug 30 05:14:43.508344 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 221/427] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:43 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1739 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:43.579127 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-072ce539-a90f-4453-826d-fb9d606aa5c9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:43.592800 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-072ce539-a90f-4453-826d-fb9d606aa5c9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1297 microversion: 2.1 time: 0.271243 Aug 30 05:14:43.595654 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 207/428] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:43 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1297 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:44.528367 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a6807f18-55dd-4b66-8e3c-f2987246e00e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:44.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a6807f18-55dd-4b66-8e3c-f2987246e00e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:44.537768 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a6807f18-55dd-4b66-8e3c-f2987246e00e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:44.539046 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a6807f18-55dd-4b66-8e3c-f2987246e00e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:44.539737 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a6807f18-55dd-4b66-8e3c-f2987246e00e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:44.540810 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a6807f18-55dd-4b66-8e3c-f2987246e00e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:44.541474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a6807f18-55dd-4b66-8e3c-f2987246e00e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:44.542213 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a6807f18-55dd-4b66-8e3c-f2987246e00e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:44.626723 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1c61abb8-ae5b-417f-b64d-b4267397d7ed tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:44.630612 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1c61abb8-ae5b-417f-b64d-b4267397d7ed tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:44.637819 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c61abb8-ae5b-417f-b64d-b4267397d7ed tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:44.640513 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c61abb8-ae5b-417f-b64d-b4267397d7ed tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:44.641350 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c61abb8-ae5b-417f-b64d-b4267397d7ed tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:44.642380 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c61abb8-ae5b-417f-b64d-b4267397d7ed tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:44.643149 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c61abb8-ae5b-417f-b64d-b4267397d7ed tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:44.643811 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1c61abb8-ae5b-417f-b64d-b4267397d7ed tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:44.874060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1c61abb8-ae5b-417f-b64d-b4267397d7ed tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:44.880460 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a6807f18-55dd-4b66-8e3c-f2987246e00e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:44.892825 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a6807f18-55dd-4b66-8e3c-f2987246e00e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:44.894290 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a6807f18-55dd-4b66-8e3c-f2987246e00e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:44.896108 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a6807f18-55dd-4b66-8e3c-f2987246e00e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1739 microversion: 2.20 time: 0.371405 Aug 30 05:14:44.905444 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1c61abb8-ae5b-417f-b64d-b4267397d7ed tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1303 microversion: 2.1 time: 0.282618 Aug 30 05:14:44.915093 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 208/429] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:44 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1303 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:44.915706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 222/430] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:44 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1739 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:45.940934 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ad88d3fc-d5ac-4cfe-8b69-dd178f3a040e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:45.943704 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-99f93703-370f-4aa3-b40e-43bc6afaf4d6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:45.944178 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ad88d3fc-d5ac-4cfe-8b69-dd178f3a040e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:45.944951 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-99f93703-370f-4aa3-b40e-43bc6afaf4d6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:45.954973 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad88d3fc-d5ac-4cfe-8b69-dd178f3a040e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:45.955473 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad88d3fc-d5ac-4cfe-8b69-dd178f3a040e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:45.955914 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad88d3fc-d5ac-4cfe-8b69-dd178f3a040e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:45.956626 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad88d3fc-d5ac-4cfe-8b69-dd178f3a040e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:45.957068 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:45.957189 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad88d3fc-d5ac-4cfe-8b69-dd178f3a040e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:45.957531 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad88d3fc-d5ac-4cfe-8b69-dd178f3a040e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:45.961421 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99f93703-370f-4aa3-b40e-43bc6afaf4d6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:45.970083 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99f93703-370f-4aa3-b40e-43bc6afaf4d6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:45.972178 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99f93703-370f-4aa3-b40e-43bc6afaf4d6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:45.973174 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99f93703-370f-4aa3-b40e-43bc6afaf4d6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:45.977083 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99f93703-370f-4aa3-b40e-43bc6afaf4d6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:45.977693 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99f93703-370f-4aa3-b40e-43bc6afaf4d6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:46.123805 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-99f93703-370f-4aa3-b40e-43bc6afaf4d6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:46.164734 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-99f93703-370f-4aa3-b40e-43bc6afaf4d6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1303 microversion: 2.1 time: 0.221446 Aug 30 05:14:46.187458 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 223/431] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:45 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1303 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:46.278066 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ad88d3fc-d5ac-4cfe-8b69-dd178f3a040e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:46.299169 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ad88d3fc-d5ac-4cfe-8b69-dd178f3a040e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:46.301333 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ad88d3fc-d5ac-4cfe-8b69-dd178f3a040e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:46.304439 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ad88d3fc-d5ac-4cfe-8b69-dd178f3a040e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1739 microversion: 2.20 time: 0.369775 Aug 30 05:14:46.306601 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 209/432] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:45 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1739 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:47.193930 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c14f2242-3949-49c7-a08d-d3b8fe8978c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:47.195173 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c14f2242-3949-49c7-a08d-d3b8fe8978c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:47.205638 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c14f2242-3949-49c7-a08d-d3b8fe8978c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:47.207393 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c14f2242-3949-49c7-a08d-d3b8fe8978c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:47.208035 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c14f2242-3949-49c7-a08d-d3b8fe8978c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:47.210483 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c14f2242-3949-49c7-a08d-d3b8fe8978c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:47.211310 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c14f2242-3949-49c7-a08d-d3b8fe8978c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:47.212657 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c14f2242-3949-49c7-a08d-d3b8fe8978c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:47.328767 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f4c16123-f5e8-449d-9177-f1f47a8e0ea3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:47.329290 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f4c16123-f5e8-449d-9177-f1f47a8e0ea3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:47.337932 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c16123-f5e8-449d-9177-f1f47a8e0ea3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:47.338587 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c16123-f5e8-449d-9177-f1f47a8e0ea3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:47.342417 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c16123-f5e8-449d-9177-f1f47a8e0ea3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:47.344646 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c16123-f5e8-449d-9177-f1f47a8e0ea3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:47.349130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c16123-f5e8-449d-9177-f1f47a8e0ea3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:47.351752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c16123-f5e8-449d-9177-f1f47a8e0ea3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:47.440132 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c14f2242-3949-49c7-a08d-d3b8fe8978c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:47.462532 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c14f2242-3949-49c7-a08d-d3b8fe8978c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1371 microversion: 2.1 time: 0.269785 Aug 30 05:14:47.481810 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 224/433] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:47 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:48.331114 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f4c16123-f5e8-449d-9177-f1f47a8e0ea3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:48.360214 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f4c16123-f5e8-449d-9177-f1f47a8e0ea3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:48.371636 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f4c16123-f5e8-449d-9177-f1f47a8e0ea3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:48.373108 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f4c16123-f5e8-449d-9177-f1f47a8e0ea3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1739 microversion: 2.20 time: 1.048340 Aug 30 05:14:48.377266 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 210/434] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:47 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1739 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:14:48.489479 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1054a249-cb46-4d54-9446-36d4ffbb5f78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:48.490100 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1054a249-cb46-4d54-9446-36d4ffbb5f78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:48.506179 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1054a249-cb46-4d54-9446-36d4ffbb5f78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:48.509653 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1054a249-cb46-4d54-9446-36d4ffbb5f78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:48.511944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1054a249-cb46-4d54-9446-36d4ffbb5f78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:48.513933 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1054a249-cb46-4d54-9446-36d4ffbb5f78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:48.520384 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1054a249-cb46-4d54-9446-36d4ffbb5f78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:48.522009 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1054a249-cb46-4d54-9446-36d4ffbb5f78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:49.068019 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1054a249-cb46-4d54-9446-36d4ffbb5f78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:49.079773 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1054a249-cb46-4d54-9446-36d4ffbb5f78 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1371 microversion: 2.1 time: 0.591261 Aug 30 05:14:49.080760 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 225/435] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:48 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1371 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:49.183145 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-196bb819-0ca7-4395-8185-d34c1b7a2c7a req-de6fef2d-1e5a-45a6-9c7d-999af9efd0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30714902-9da4-4ee8-8cb1-bd37f13ce234", "tag": "361c8508-8cc9-4e2d-95e0-07af85e45dfa"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:49.203668 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-196bb819-0ca7-4395-8185-d34c1b7a2c7a req-de6fef2d-1e5a-45a6-9c7d-999af9efd0f4 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:49.204160 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-196bb819-0ca7-4395-8185-d34c1b7a2c7a req-de6fef2d-1e5a-45a6-9c7d-999af9efd0f4 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:49.204594 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-196bb819-0ca7-4395-8185-d34c1b7a2c7a req-de6fef2d-1e5a-45a6-9c7d-999af9efd0f4 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:49.229719 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-196bb819-0ca7-4395-8185-d34c1b7a2c7a req-de6fef2d-1e5a-45a6-9c7d-999af9efd0f4 service nova] Creating event network-changed:361c8508-8cc9-4e2d-95e0-07af85e45dfa for instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 on hv-cinder-85391 Aug 30 05:14:49.237146 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-196bb819-0ca7-4395-8185-d34c1b7a2c7a req-de6fef2d-1e5a-45a6-9c7d-999af9efd0f4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057785 Aug 30 05:14:49.241318 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 211/436] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:14:49.399198 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e55382bc-dad3-4ac7-b909-125676d17cee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:49.400053 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e55382bc-dad3-4ac7-b909-125676d17cee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:49.411564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e55382bc-dad3-4ac7-b909-125676d17cee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:49.412982 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e55382bc-dad3-4ac7-b909-125676d17cee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:49.415051 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e55382bc-dad3-4ac7-b909-125676d17cee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:49.416130 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e55382bc-dad3-4ac7-b909-125676d17cee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:49.418153 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e55382bc-dad3-4ac7-b909-125676d17cee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:49.418775 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e55382bc-dad3-4ac7-b909-125676d17cee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:49.712008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e55382bc-dad3-4ac7-b909-125676d17cee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:49.741372 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e55382bc-dad3-4ac7-b909-125676d17cee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:49.743118 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e55382bc-dad3-4ac7-b909-125676d17cee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:49.744548 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e55382bc-dad3-4ac7-b909-125676d17cee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1739 microversion: 2.20 time: 0.350458 Aug 30 05:14:49.745694 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 226/437] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:49 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1739 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:50.102390 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-611fa836-46a1-4619-b718-cb2138faae32 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:50.103242 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-611fa836-46a1-4619-b718-cb2138faae32 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:50.119805 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-611fa836-46a1-4619-b718-cb2138faae32 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:50.120806 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-611fa836-46a1-4619-b718-cb2138faae32 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:50.120961 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-611fa836-46a1-4619-b718-cb2138faae32 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:50.121729 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-611fa836-46a1-4619-b718-cb2138faae32 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:50.122267 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-611fa836-46a1-4619-b718-cb2138faae32 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:50.122792 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-611fa836-46a1-4619-b718-cb2138faae32 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:50.380983 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-611fa836-46a1-4619-b718-cb2138faae32 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:50.397102 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-611fa836-46a1-4619-b718-cb2138faae32 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1371 microversion: 2.1 time: 0.297848 Aug 30 05:14:50.399113 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 212/438] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:50 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1371 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:50.777264 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-294c421f-a65c-4bc4-aab1-772da81a1683 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:50.778449 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-294c421f-a65c-4bc4-aab1-772da81a1683 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:50.812534 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-294c421f-a65c-4bc4-aab1-772da81a1683 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:50.813423 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-294c421f-a65c-4bc4-aab1-772da81a1683 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:50.814174 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-294c421f-a65c-4bc4-aab1-772da81a1683 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:50.815160 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-294c421f-a65c-4bc4-aab1-772da81a1683 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:50.816126 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-294c421f-a65c-4bc4-aab1-772da81a1683 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:50.816701 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-294c421f-a65c-4bc4-aab1-772da81a1683 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:50.828758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:50.891291 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:51.177899 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-294c421f-a65c-4bc4-aab1-772da81a1683 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:51.189699 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-294c421f-a65c-4bc4-aab1-772da81a1683 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:51.194285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-294c421f-a65c-4bc4-aab1-772da81a1683 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:51.198604 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-294c421f-a65c-4bc4-aab1-772da81a1683 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1739 microversion: 2.20 time: 0.430885 Aug 30 05:14:51.213076 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 227/439] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:50 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1739 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:51.418021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-03cd07c1-4b76-4293-8af0-22653034f3fe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:51.419283 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-03cd07c1-4b76-4293-8af0-22653034f3fe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:51.427490 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=6 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:51.437759 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03cd07c1-4b76-4293-8af0-22653034f3fe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:51.438944 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03cd07c1-4b76-4293-8af0-22653034f3fe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:51.439767 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03cd07c1-4b76-4293-8af0-22653034f3fe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:51.440738 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03cd07c1-4b76-4293-8af0-22653034f3fe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:51.441344 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03cd07c1-4b76-4293-8af0-22653034f3fe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:51.442459 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03cd07c1-4b76-4293-8af0-22653034f3fe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:51.790645 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-03cd07c1-4b76-4293-8af0-22653034f3fe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:51.807802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-03cd07c1-4b76-4293-8af0-22653034f3fe tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1371 microversion: 2.1 time: 0.391307 Aug 30 05:14:51.822261 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 213/440] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:51 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1371 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:52.233921 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-baab1734-5660-4713-b645-7213871986a2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:52.235908 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-baab1734-5660-4713-b645-7213871986a2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:52.246655 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-baab1734-5660-4713-b645-7213871986a2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:52.247695 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-baab1734-5660-4713-b645-7213871986a2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:52.248466 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-baab1734-5660-4713-b645-7213871986a2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:52.250745 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-baab1734-5660-4713-b645-7213871986a2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:52.252564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-baab1734-5660-4713-b645-7213871986a2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:52.254125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-baab1734-5660-4713-b645-7213871986a2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:52.464287 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-baab1734-5660-4713-b645-7213871986a2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:52.475758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-baab1734-5660-4713-b645-7213871986a2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:52.478657 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-baab1734-5660-4713-b645-7213871986a2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:52.480418 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-baab1734-5660-4713-b645-7213871986a2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1739 microversion: 2.20 time: 0.254046 Aug 30 05:14:52.497168 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 228/441] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:52 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:52.829557 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2c6f3066-9dca-4dfe-b7eb-5765c9067459 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:52.830791 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2c6f3066-9dca-4dfe-b7eb-5765c9067459 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:52.838468 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c6f3066-9dca-4dfe-b7eb-5765c9067459 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:52.839076 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c6f3066-9dca-4dfe-b7eb-5765c9067459 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:52.839579 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c6f3066-9dca-4dfe-b7eb-5765c9067459 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:52.840434 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c6f3066-9dca-4dfe-b7eb-5765c9067459 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:52.841129 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c6f3066-9dca-4dfe-b7eb-5765c9067459 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:52.841765 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2c6f3066-9dca-4dfe-b7eb-5765c9067459 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:53.347659 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2c6f3066-9dca-4dfe-b7eb-5765c9067459 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:53.355896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2c6f3066-9dca-4dfe-b7eb-5765c9067459 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1371 microversion: 2.1 time: 0.530519 Aug 30 05:14:53.356473 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 214/442] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:52 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1371 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:53.506343 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a60d7341-356c-41db-accd-3ebbc29395bc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:53.507162 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a60d7341-356c-41db-accd-3ebbc29395bc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:53.513701 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a60d7341-356c-41db-accd-3ebbc29395bc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:53.514266 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a60d7341-356c-41db-accd-3ebbc29395bc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:53.514775 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a60d7341-356c-41db-accd-3ebbc29395bc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:53.515795 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a60d7341-356c-41db-accd-3ebbc29395bc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:53.516419 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a60d7341-356c-41db-accd-3ebbc29395bc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:53.516946 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a60d7341-356c-41db-accd-3ebbc29395bc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:53.682521 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a60d7341-356c-41db-accd-3ebbc29395bc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:53.692532 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a60d7341-356c-41db-accd-3ebbc29395bc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:53.695362 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a60d7341-356c-41db-accd-3ebbc29395bc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:53.697057 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a60d7341-356c-41db-accd-3ebbc29395bc tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1721 microversion: 2.20 time: 0.195539 Aug 30 05:14:53.697838 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 229/443] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:53 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:54.320025 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e47b57cd-5465-4b84-8753-87854033d448 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Action: 'create', calling method: .version_select at 0x7f822eecb040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1477137281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpWP/cBkY7+abpbfXn9fR14MphVBdUSsHd2+9lMWyhtPutQzeT2SWSyPpkHpq3mvxSH3XnEiXl66UsK0MY9AfK+k7W41aVFfaEvA1JQm0Lk5MTNHnU97ppF9RGMyUfZeg=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:54.325408 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:54.338989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-e47b57cd-5465-4b84-8753-87854033d448 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Getting quotas for project 97e3452b02294219ae56cd23eb2aa0ce. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:14:54.343173 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-e47b57cd-5465-4b84-8753-87854033d448 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Getting quotas for user 9256fd43e5124fb68d4e5453584d1e8d and project 97e3452b02294219ae56cd23eb2aa0ce. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:14:54.365827 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e47b57cd-5465-4b84-8753-87854033d448 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.241390 Aug 30 05:14:54.366435 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 215/444] 10.222.0.77 () {60 vars in 1159 bytes} [Tue Aug 30 05:14:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:14:54.376994 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-adf64e0c-75cc-483e-b40b-dbe4e2058abd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:54.378079 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-adf64e0c-75cc-483e-b40b-dbe4e2058abd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:54.384813 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-adf64e0c-75cc-483e-b40b-dbe4e2058abd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:54.385421 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-adf64e0c-75cc-483e-b40b-dbe4e2058abd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:54.385859 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-adf64e0c-75cc-483e-b40b-dbe4e2058abd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:54.386555 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-adf64e0c-75cc-483e-b40b-dbe4e2058abd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:54.387137 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-adf64e0c-75cc-483e-b40b-dbe4e2058abd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:54.387567 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-adf64e0c-75cc-483e-b40b-dbe4e2058abd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:54.393177 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:54.593907 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-adf64e0c-75cc-483e-b40b-dbe4e2058abd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:54.604146 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-adf64e0c-75cc-483e-b40b-dbe4e2058abd tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1371 microversion: 2.1 time: 0.230922 Aug 30 05:14:54.604994 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 230/445] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:54 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:54.721102 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e2e4032a-a387-4cdd-8e0e-3e8ccd26ae52 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:54.721953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e2e4032a-a387-4cdd-8e0e-3e8ccd26ae52 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:54.729354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2e4032a-a387-4cdd-8e0e-3e8ccd26ae52 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:54.729847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2e4032a-a387-4cdd-8e0e-3e8ccd26ae52 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:54.730283 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2e4032a-a387-4cdd-8e0e-3e8ccd26ae52 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:54.731024 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2e4032a-a387-4cdd-8e0e-3e8ccd26ae52 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:54.731479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2e4032a-a387-4cdd-8e0e-3e8ccd26ae52 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:54.731908 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e2e4032a-a387-4cdd-8e0e-3e8ccd26ae52 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:54.914800 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e2e4032a-a387-4cdd-8e0e-3e8ccd26ae52 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:54.924816 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e2e4032a-a387-4cdd-8e0e-3e8ccd26ae52 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:54.926986 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e2e4032a-a387-4cdd-8e0e-3e8ccd26ae52 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:54.928331 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e2e4032a-a387-4cdd-8e0e-3e8ccd26ae52 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1721 microversion: 2.20 time: 0.211606 Aug 30 05:14:54.928880 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 216/446] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:54 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:55.625302 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bf4a9b8c-733e-4ab0-834c-6b959b2c6c27 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:55.625924 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bf4a9b8c-733e-4ab0-834c-6b959b2c6c27 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:55.639120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf4a9b8c-733e-4ab0-834c-6b959b2c6c27 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:55.639527 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf4a9b8c-733e-4ab0-834c-6b959b2c6c27 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:55.639988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf4a9b8c-733e-4ab0-834c-6b959b2c6c27 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:55.640710 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf4a9b8c-733e-4ab0-834c-6b959b2c6c27 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:55.641176 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf4a9b8c-733e-4ab0-834c-6b959b2c6c27 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:55.641607 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf4a9b8c-733e-4ab0-834c-6b959b2c6c27 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:55.783065 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bf4a9b8c-733e-4ab0-834c-6b959b2c6c27 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:55.791525 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bf4a9b8c-733e-4ab0-834c-6b959b2c6c27 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1371 microversion: 2.1 time: 0.171003 Aug 30 05:14:55.792488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 231/447] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:55 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:55.952805 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f360f9d8-da34-4df5-a0a8-e7254c221c05 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:55.954503 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f360f9d8-da34-4df5-a0a8-e7254c221c05 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:55.962839 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f360f9d8-da34-4df5-a0a8-e7254c221c05 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:55.963358 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f360f9d8-da34-4df5-a0a8-e7254c221c05 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:55.963800 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f360f9d8-da34-4df5-a0a8-e7254c221c05 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:55.964504 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f360f9d8-da34-4df5-a0a8-e7254c221c05 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:55.964968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f360f9d8-da34-4df5-a0a8-e7254c221c05 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:55.965395 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f360f9d8-da34-4df5-a0a8-e7254c221c05 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:56.100216 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f360f9d8-da34-4df5-a0a8-e7254c221c05 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:56.108239 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f360f9d8-da34-4df5-a0a8-e7254c221c05 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:56.109682 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f360f9d8-da34-4df5-a0a8-e7254c221c05 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:56.110859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f360f9d8-da34-4df5-a0a8-e7254c221c05 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1721 microversion: 2.20 time: 0.162756 Aug 30 05:14:56.111426 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 217/448] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:55 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:56.814489 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f4b3f981-7f71-47af-ad6d-2e811c5d8f4f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:56.815141 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f4b3f981-7f71-47af-ad6d-2e811c5d8f4f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:56.821774 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4b3f981-7f71-47af-ad6d-2e811c5d8f4f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:56.822252 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4b3f981-7f71-47af-ad6d-2e811c5d8f4f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:56.822713 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4b3f981-7f71-47af-ad6d-2e811c5d8f4f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:56.823602 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4b3f981-7f71-47af-ad6d-2e811c5d8f4f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:56.824054 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4b3f981-7f71-47af-ad6d-2e811c5d8f4f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:56.824474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f4b3f981-7f71-47af-ad6d-2e811c5d8f4f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:56.977532 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f4b3f981-7f71-47af-ad6d-2e811c5d8f4f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:56.985321 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f4b3f981-7f71-47af-ad6d-2e811c5d8f4f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1371 microversion: 2.1 time: 0.175943 Aug 30 05:14:56.986037 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 232/449] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:56 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:57.134577 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a1d92e5e-0bea-49c9-a2c6-84abf22f8a18 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:57.135533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a1d92e5e-0bea-49c9-a2c6-84abf22f8a18 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:57.141544 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1d92e5e-0bea-49c9-a2c6-84abf22f8a18 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:57.142357 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1d92e5e-0bea-49c9-a2c6-84abf22f8a18 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:57.142899 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1d92e5e-0bea-49c9-a2c6-84abf22f8a18 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:57.143679 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1d92e5e-0bea-49c9-a2c6-84abf22f8a18 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:57.144213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1d92e5e-0bea-49c9-a2c6-84abf22f8a18 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:57.145397 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1d92e5e-0bea-49c9-a2c6-84abf22f8a18 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:57.474997 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a1d92e5e-0bea-49c9-a2c6-84abf22f8a18 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:57.497423 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a1d92e5e-0bea-49c9-a2c6-84abf22f8a18 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:57.500272 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a1d92e5e-0bea-49c9-a2c6-84abf22f8a18 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:57.501768 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a1d92e5e-0bea-49c9-a2c6-84abf22f8a18 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1721 microversion: 2.20 time: 0.372272 Aug 30 05:14:57.503141 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 218/450] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:57 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1721 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:58.009546 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0a3491b7-86c9-4329-aca8-fcad42a928bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:58.013818 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0a3491b7-86c9-4329-aca8-fcad42a928bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:58.025318 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a3491b7-86c9-4329-aca8-fcad42a928bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.027261 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a3491b7-86c9-4329-aca8-fcad42a928bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.028239 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a3491b7-86c9-4329-aca8-fcad42a928bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.029209 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a3491b7-86c9-4329-aca8-fcad42a928bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.029785 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a3491b7-86c9-4329-aca8-fcad42a928bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.030284 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0a3491b7-86c9-4329-aca8-fcad42a928bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.190645 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0a3491b7-86c9-4329-aca8-fcad42a928bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:58.199656 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0a3491b7-86c9-4329-aca8-fcad42a928bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1371 microversion: 2.1 time: 0.193747 Aug 30 05:14:58.203452 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 233/451] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:58 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:58.526268 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-03410a32-d2ac-4164-b8d4-68a612ee882e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:58.526913 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-03410a32-d2ac-4164-b8d4-68a612ee882e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:58.533428 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03410a32-d2ac-4164-b8d4-68a612ee882e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.533920 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03410a32-d2ac-4164-b8d4-68a612ee882e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.534363 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03410a32-d2ac-4164-b8d4-68a612ee882e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.535090 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03410a32-d2ac-4164-b8d4-68a612ee882e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.536190 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03410a32-d2ac-4164-b8d4-68a612ee882e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.536619 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03410a32-d2ac-4164-b8d4-68a612ee882e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.554049 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-db53f277-e87c-46fc-bc37-32f9697b443e req-aeec8f24-4bde-40f3-b97d-31c3f63e6d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f83c589-3a23-45aa-96c5-3cf9006b3830", "name": "network-vif-unplugged", "status": "completed", "tag": "c5da19b6-98a0-4af9-b8f5-52291d4a9be0"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:58.566573 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-db53f277-e87c-46fc-bc37-32f9697b443e req-aeec8f24-4bde-40f3-b97d-31c3f63e6d9b service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.567667 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-db53f277-e87c-46fc-bc37-32f9697b443e req-aeec8f24-4bde-40f3-b97d-31c3f63e6d9b service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.571280 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-db53f277-e87c-46fc-bc37-32f9697b443e req-aeec8f24-4bde-40f3-b97d-31c3f63e6d9b service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.589893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-db53f277-e87c-46fc-bc37-32f9697b443e req-aeec8f24-4bde-40f3-b97d-31c3f63e6d9b service nova] Creating event network-vif-unplugged:c5da19b6-98a0-4af9-b8f5-52291d4a9be0 for instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 on hv-cinder-85391 Aug 30 05:14:58.600665 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-db53f277-e87c-46fc-bc37-32f9697b443e req-aeec8f24-4bde-40f3-b97d-31c3f63e6d9b service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050062 Aug 30 05:14:58.602249 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 234/452] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:14:58.718437 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-03410a32-d2ac-4164-b8d4-68a612ee882e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:58.728175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-03410a32-d2ac-4164-b8d4-68a612ee882e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:58.729617 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-03410a32-d2ac-4164-b8d4-68a612ee882e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:58.730798 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-03410a32-d2ac-4164-b8d4-68a612ee882e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1721 microversion: 2.20 time: 0.208596 Aug 30 05:14:58.731377 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 219/453] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:58 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:14:59.221631 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c9cdf9f5-c03a-4a30-b163-d883289735c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:59.222326 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c9cdf9f5-c03a-4a30-b163-d883289735c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:59.229012 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9cdf9f5-c03a-4a30-b163-d883289735c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:59.229497 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9cdf9f5-c03a-4a30-b163-d883289735c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:59.229999 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9cdf9f5-c03a-4a30-b163-d883289735c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:59.230612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9cdf9f5-c03a-4a30-b163-d883289735c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:59.231090 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9cdf9f5-c03a-4a30-b163-d883289735c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:59.231546 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9cdf9f5-c03a-4a30-b163-d883289735c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:59.365684 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c9cdf9f5-c03a-4a30-b163-d883289735c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:59.373158 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c9cdf9f5-c03a-4a30-b163-d883289735c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1371 microversion: 2.1 time: 0.156501 Aug 30 05:14:59.373726 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 235/454] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:59 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:59.753390 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4e1e7803-db05-4b24-96b3-13351665373f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:59.754004 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4e1e7803-db05-4b24-96b3-13351665373f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:59.760948 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e1e7803-db05-4b24-96b3-13351665373f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:59.761469 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e1e7803-db05-4b24-96b3-13351665373f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:59.762030 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e1e7803-db05-4b24-96b3-13351665373f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:59.762913 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e1e7803-db05-4b24-96b3-13351665373f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:59.763376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e1e7803-db05-4b24-96b3-13351665373f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:59.763805 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4e1e7803-db05-4b24-96b3-13351665373f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:59.896701 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4e1e7803-db05-4b24-96b3-13351665373f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:59.904651 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4e1e7803-db05-4b24-96b3-13351665373f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:59.906125 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4e1e7803-db05-4b24-96b3-13351665373f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:59.907336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4e1e7803-db05-4b24-96b3-13351665373f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1721 microversion: 2.20 time: 0.157767 Aug 30 05:14:59.907952 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 220/455] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:14:59 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:00.395456 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-141245ec-92af-4a18-a02f-392aa38bde31 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:00.396079 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-141245ec-92af-4a18-a02f-392aa38bde31 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:00.402806 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-141245ec-92af-4a18-a02f-392aa38bde31 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:00.403309 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-141245ec-92af-4a18-a02f-392aa38bde31 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:00.403976 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-141245ec-92af-4a18-a02f-392aa38bde31 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:00.404904 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-141245ec-92af-4a18-a02f-392aa38bde31 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:00.405360 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-141245ec-92af-4a18-a02f-392aa38bde31 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:00.405885 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-141245ec-92af-4a18-a02f-392aa38bde31 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:00.576309 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-141245ec-92af-4a18-a02f-392aa38bde31 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:00.585141 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-141245ec-92af-4a18-a02f-392aa38bde31 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1371 microversion: 2.1 time: 0.194766 Aug 30 05:15:00.585796 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 236/456] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:00 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:00.827078 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8e1c735a-9c31-4157-a0ca-1afdf6bab601 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:00.827910 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8e1c735a-9c31-4157-a0ca-1afdf6bab601 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:00.835233 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e1c735a-9c31-4157-a0ca-1afdf6bab601 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:00.835729 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e1c735a-9c31-4157-a0ca-1afdf6bab601 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:00.836165 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e1c735a-9c31-4157-a0ca-1afdf6bab601 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:00.836868 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e1c735a-9c31-4157-a0ca-1afdf6bab601 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:00.837327 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e1c735a-9c31-4157-a0ca-1afdf6bab601 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:00.837898 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8e1c735a-9c31-4157-a0ca-1afdf6bab601 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:00.930300 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4c5b3b98-e78a-4b30-b393-f727b122d3c1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:00.930938 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4c5b3b98-e78a-4b30-b393-f727b122d3c1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:00.937214 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c5b3b98-e78a-4b30-b393-f727b122d3c1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:00.937705 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c5b3b98-e78a-4b30-b393-f727b122d3c1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:00.938135 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c5b3b98-e78a-4b30-b393-f727b122d3c1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:00.939055 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c5b3b98-e78a-4b30-b393-f727b122d3c1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:00.939504 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c5b3b98-e78a-4b30-b393-f727b122d3c1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:00.939925 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4c5b3b98-e78a-4b30-b393-f727b122d3c1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:00.973505 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-8e1c735a-9c31-4157-a0ca-1afdf6bab601 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lazy-loading 'services' on Instance uuid 48af496a-2b9e-4b18-aad8-59e43cfa075b {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:15:01.012168 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:01.086583 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4c5b3b98-e78a-4b30-b393-f727b122d3c1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:01.095084 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4c5b3b98-e78a-4b30-b393-f727b122d3c1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:01.096550 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4c5b3b98-e78a-4b30-b393-f727b122d3c1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:01.098356 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4c5b3b98-e78a-4b30-b393-f727b122d3c1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1724 microversion: 2.20 time: 0.172088 Aug 30 05:15:01.098719 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8e1c735a-9c31-4157-a0ca-1afdf6bab601 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "DELETE /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b/os-volume_attachments/c59a5b9d-d8fb-4812-828b-1b6719061411" status: 202 len: 0 microversion: 2.1 time: 0.276069 Aug 30 05:15:01.098962 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 237/457] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:00 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:15:01.099543 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 221/458] 10.222.0.77 () {58 vars in 1416 bytes} [Tue Aug 30 05:15:00 2022] DELETE /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b/os-volume_attachments/c59a5b9d-d8fb-4812-828b-1b6719061411 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:15:01.126450 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d306db59-70d8-4d90-b486-274c0049ee04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20941f20-c4e1-4849-b60a-3c0aa5550146"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:01.128900 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d306db59-70d8-4d90-b486-274c0049ee04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:01.135285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d306db59-70d8-4d90-b486-274c0049ee04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:01.135799 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d306db59-70d8-4d90-b486-274c0049ee04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:01.136402 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d306db59-70d8-4d90-b486-274c0049ee04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:01.137251 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d306db59-70d8-4d90-b486-274c0049ee04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:01.137875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d306db59-70d8-4d90-b486-274c0049ee04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:01.138480 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d306db59-70d8-4d90-b486-274c0049ee04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:01.451301 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d306db59-70d8-4d90-b486-274c0049ee04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "POST /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.330587 Aug 30 05:15:01.451933 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 238/459] 10.222.0.77 () {62 vars in 1364 bytes} [Tue Aug 30 05:15:01 2022] POST /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/os-volume_attachments => generated 188 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:15:01.600526 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fd25c78a-67ec-43d5-897e-3c16856b95c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:01.601209 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fd25c78a-67ec-43d5-897e-3c16856b95c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:01.605597 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-aa50d2cc-af0a-4338-b67c-4a3629fa19c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:01.606324 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-aa50d2cc-af0a-4338-b67c-4a3629fa19c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:01.607709 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd25c78a-67ec-43d5-897e-3c16856b95c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:01.608199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd25c78a-67ec-43d5-897e-3c16856b95c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:01.608632 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd25c78a-67ec-43d5-897e-3c16856b95c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:01.609322 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd25c78a-67ec-43d5-897e-3c16856b95c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:01.609775 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd25c78a-67ec-43d5-897e-3c16856b95c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:01.610200 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd25c78a-67ec-43d5-897e-3c16856b95c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:01.614423 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa50d2cc-af0a-4338-b67c-4a3629fa19c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:01.615002 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa50d2cc-af0a-4338-b67c-4a3629fa19c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:01.615503 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa50d2cc-af0a-4338-b67c-4a3629fa19c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:01.616266 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa50d2cc-af0a-4338-b67c-4a3629fa19c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:01.616779 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa50d2cc-af0a-4338-b67c-4a3629fa19c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:01.617265 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aa50d2cc-af0a-4338-b67c-4a3629fa19c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:01.657973 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fd25c78a-67ec-43d5-897e-3c16856b95c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120573) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 05:15:01.728321 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fd25c78a-67ec-43d5-897e-3c16856b95c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "POST /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/action" status: 202 len: 0 microversion: 2.20 time: 0.132295 Aug 30 05:15:01.732318 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 222/460] 10.222.0.77 () {62 vars in 1319 bytes} [Tue Aug 30 05:15:01 2022] POST /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:15:01.737051 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1f2d4995-386e-4dea-b775-96023f15d056 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:01.737676 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1f2d4995-386e-4dea-b775-96023f15d056 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:01.744243 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f2d4995-386e-4dea-b775-96023f15d056 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:01.744730 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f2d4995-386e-4dea-b775-96023f15d056 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:01.745161 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f2d4995-386e-4dea-b775-96023f15d056 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:01.745852 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f2d4995-386e-4dea-b775-96023f15d056 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:01.746472 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f2d4995-386e-4dea-b775-96023f15d056 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:01.746721 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f2d4995-386e-4dea-b775-96023f15d056 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:01.755888 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aa50d2cc-af0a-4338-b67c-4a3629fa19c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:01.765714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-aa50d2cc-af0a-4338-b67c-4a3629fa19c2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1371 microversion: 2.1 time: 0.163968 Aug 30 05:15:01.767750 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 239/461] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:01 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:15:01.889989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1f2d4995-386e-4dea-b775-96023f15d056 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:01.908869 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1f2d4995-386e-4dea-b775-96023f15d056 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:01.910868 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1f2d4995-386e-4dea-b775-96023f15d056 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:01.913042 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1f2d4995-386e-4dea-b775-96023f15d056 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1750 microversion: 2.20 time: 0.178786 Aug 30 05:15:01.913613 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 223/462] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:01 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:02.646395 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-bc254c65-bcd3-4f1a-9be9-0cf9b2e409d2 req-4fa0a95c-8697-4e71-8f03-701a14e905c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30714902-9da4-4ee8-8cb1-bd37f13ce234", "name": "network-vif-plugged", "status": "completed", "tag": "361c8508-8cc9-4e2d-95e0-07af85e45dfa"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:02.657123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bc254c65-bcd3-4f1a-9be9-0cf9b2e409d2 req-4fa0a95c-8697-4e71-8f03-701a14e905c6 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:02.657650 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bc254c65-bcd3-4f1a-9be9-0cf9b2e409d2 req-4fa0a95c-8697-4e71-8f03-701a14e905c6 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:02.658177 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-bc254c65-bcd3-4f1a-9be9-0cf9b2e409d2 req-4fa0a95c-8697-4e71-8f03-701a14e905c6 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:02.679674 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-bc254c65-bcd3-4f1a-9be9-0cf9b2e409d2 req-4fa0a95c-8697-4e71-8f03-701a14e905c6 service nova] Creating event network-vif-plugged:361c8508-8cc9-4e2d-95e0-07af85e45dfa for instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 on hv-cinder-85391 Aug 30 05:15:02.684690 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-bc254c65-bcd3-4f1a-9be9-0cf9b2e409d2 req-4fa0a95c-8697-4e71-8f03-701a14e905c6 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042507 Aug 30 05:15:02.685406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 240/463] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:15:02.788858 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aae5655d-60fa-4a45-a92b-2d072a9f6027 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:02.789559 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-aae5655d-60fa-4a45-a92b-2d072a9f6027 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:02.796438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aae5655d-60fa-4a45-a92b-2d072a9f6027 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:02.797119 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aae5655d-60fa-4a45-a92b-2d072a9f6027 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:02.797639 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aae5655d-60fa-4a45-a92b-2d072a9f6027 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:02.798411 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aae5655d-60fa-4a45-a92b-2d072a9f6027 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:02.799120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aae5655d-60fa-4a45-a92b-2d072a9f6027 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:02.799753 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aae5655d-60fa-4a45-a92b-2d072a9f6027 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:02.938223 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ff2d1f5a-be4a-4dba-9c93-f847a50c6c04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:02.938954 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ff2d1f5a-be4a-4dba-9c93-f847a50c6c04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:02.945137 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff2d1f5a-be4a-4dba-9c93-f847a50c6c04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:02.945625 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff2d1f5a-be4a-4dba-9c93-f847a50c6c04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:02.946062 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff2d1f5a-be4a-4dba-9c93-f847a50c6c04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:02.946962 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff2d1f5a-be4a-4dba-9c93-f847a50c6c04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:02.947427 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff2d1f5a-be4a-4dba-9c93-f847a50c6c04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:02.947854 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff2d1f5a-be4a-4dba-9c93-f847a50c6c04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:03.019456 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aae5655d-60fa-4a45-a92b-2d072a9f6027 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:03.028111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aae5655d-60fa-4a45-a92b-2d072a9f6027 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1371 microversion: 2.1 time: 0.243611 Aug 30 05:15:03.028694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 224/464] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:02 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:03.086945 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ff2d1f5a-be4a-4dba-9c93-f847a50c6c04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:03.095948 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ff2d1f5a-be4a-4dba-9c93-f847a50c6c04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:03.097370 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ff2d1f5a-be4a-4dba-9c93-f847a50c6c04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:03.099202 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ff2d1f5a-be4a-4dba-9c93-f847a50c6c04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1752 microversion: 2.20 time: 0.165330 Aug 30 05:15:03.099762 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 241/465] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:02 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:03.316648 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4047da78-8c84-497d-b5a9-ff2a750679d5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:03.317547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4047da78-8c84-497d-b5a9-ff2a750679d5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:03.324474 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4047da78-8c84-497d-b5a9-ff2a750679d5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:03.324894 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4047da78-8c84-497d-b5a9-ff2a750679d5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:03.325326 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4047da78-8c84-497d-b5a9-ff2a750679d5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:03.326028 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4047da78-8c84-497d-b5a9-ff2a750679d5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:03.326490 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4047da78-8c84-497d-b5a9-ff2a750679d5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:03.327005 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4047da78-8c84-497d-b5a9-ff2a750679d5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:03.358433 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4047da78-8c84-497d-b5a9-ff2a750679d5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:15:03.441079 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4047da78-8c84-497d-b5a9-ff2a750679d5 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "DELETE /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 204 len: 0 microversion: 2.1 time: 0.128767 Aug 30 05:15:03.445610 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 225/466] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:15:03 2022] DELETE /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:15:03.451376 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d2631570-8cce-4c22-a441-177c12bdf09c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:03.452934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d2631570-8cce-4c22-a441-177c12bdf09c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:03.459795 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2631570-8cce-4c22-a441-177c12bdf09c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:03.460208 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2631570-8cce-4c22-a441-177c12bdf09c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:03.460639 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2631570-8cce-4c22-a441-177c12bdf09c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:03.461333 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2631570-8cce-4c22-a441-177c12bdf09c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:03.461781 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2631570-8cce-4c22-a441-177c12bdf09c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:03.462201 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2631570-8cce-4c22-a441-177c12bdf09c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:03.595982 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d2631570-8cce-4c22-a441-177c12bdf09c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:03.604803 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d2631570-8cce-4c22-a441-177c12bdf09c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1513 microversion: 2.1 time: 0.157803 Aug 30 05:15:03.605503 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 242/467] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:03 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:04.050074 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d0a8fb7b-c482-4edc-8646-46f5c570c111 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:04.051299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d0a8fb7b-c482-4edc-8646-46f5c570c111 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:04.057590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0a8fb7b-c482-4edc-8646-46f5c570c111 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:04.058085 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0a8fb7b-c482-4edc-8646-46f5c570c111 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:04.058529 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0a8fb7b-c482-4edc-8646-46f5c570c111 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:04.059258 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0a8fb7b-c482-4edc-8646-46f5c570c111 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:04.059719 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0a8fb7b-c482-4edc-8646-46f5c570c111 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:04.060147 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d0a8fb7b-c482-4edc-8646-46f5c570c111 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:04.121558 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-26961b29-fe88-4325-857a-6a02d84f3150 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:04.122269 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-26961b29-fe88-4325-857a-6a02d84f3150 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:04.129073 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26961b29-fe88-4325-857a-6a02d84f3150 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:04.129561 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26961b29-fe88-4325-857a-6a02d84f3150 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:04.129993 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26961b29-fe88-4325-857a-6a02d84f3150 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:04.130682 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26961b29-fe88-4325-857a-6a02d84f3150 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:04.131157 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26961b29-fe88-4325-857a-6a02d84f3150 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:04.131576 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26961b29-fe88-4325-857a-6a02d84f3150 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:04.198782 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d0a8fb7b-c482-4edc-8646-46f5c570c111 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:04.207388 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d0a8fb7b-c482-4edc-8646-46f5c570c111 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1371 microversion: 2.1 time: 0.161407 Aug 30 05:15:04.207964 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 226/468] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:04 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:04.263896 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-26961b29-fe88-4325-857a-6a02d84f3150 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:04.272520 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-26961b29-fe88-4325-857a-6a02d84f3150 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:04.273966 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-26961b29-fe88-4325-857a-6a02d84f3150 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:04.275153 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-26961b29-fe88-4325-857a-6a02d84f3150 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1752 microversion: 2.20 time: 0.157571 Aug 30 05:15:04.275725 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 243/469] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:04 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:15:04.626459 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-78150e56-25c4-4b7d-b8f5-6e7ee55b038e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:04.627036 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-78150e56-25c4-4b7d-b8f5-6e7ee55b038e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:04.629044 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=4 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:04.634299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78150e56-25c4-4b7d-b8f5-6e7ee55b038e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:04.634793 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78150e56-25c4-4b7d-b8f5-6e7ee55b038e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:04.635258 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78150e56-25c4-4b7d-b8f5-6e7ee55b038e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:04.635966 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78150e56-25c4-4b7d-b8f5-6e7ee55b038e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:04.636431 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78150e56-25c4-4b7d-b8f5-6e7ee55b038e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:04.636860 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78150e56-25c4-4b7d-b8f5-6e7ee55b038e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:04.764841 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-78150e56-25c4-4b7d-b8f5-6e7ee55b038e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:04.773659 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-78150e56-25c4-4b7d-b8f5-6e7ee55b038e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1513 microversion: 2.1 time: 0.151261 Aug 30 05:15:04.774230 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 227/470] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:04 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:05.228649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-097b2f52-b3d6-4618-b1d3-0e1b5c2b5fb0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:05.229337 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-097b2f52-b3d6-4618-b1d3-0e1b5c2b5fb0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:05.235961 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-097b2f52-b3d6-4618-b1d3-0e1b5c2b5fb0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:05.236449 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-097b2f52-b3d6-4618-b1d3-0e1b5c2b5fb0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:05.236887 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-097b2f52-b3d6-4618-b1d3-0e1b5c2b5fb0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:05.237639 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-097b2f52-b3d6-4618-b1d3-0e1b5c2b5fb0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:05.238093 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-097b2f52-b3d6-4618-b1d3-0e1b5c2b5fb0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:05.239133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-097b2f52-b3d6-4618-b1d3-0e1b5c2b5fb0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:05.297509 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1d34e3aa-7d7e-4e15-b788-6d4e3e06b130 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:05.298228 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1d34e3aa-7d7e-4e15-b788-6d4e3e06b130 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:05.304699 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d34e3aa-7d7e-4e15-b788-6d4e3e06b130 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:05.305205 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d34e3aa-7d7e-4e15-b788-6d4e3e06b130 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:05.305640 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d34e3aa-7d7e-4e15-b788-6d4e3e06b130 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:05.306328 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d34e3aa-7d7e-4e15-b788-6d4e3e06b130 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:05.306778 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d34e3aa-7d7e-4e15-b788-6d4e3e06b130 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:05.307299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d34e3aa-7d7e-4e15-b788-6d4e3e06b130 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:05.373620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-097b2f52-b3d6-4618-b1d3-0e1b5c2b5fb0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:05.383636 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-097b2f52-b3d6-4618-b1d3-0e1b5c2b5fb0 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1371 microversion: 2.1 time: 0.158833 Aug 30 05:15:05.384223 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 244/471] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:05 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:05.446009 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1d34e3aa-7d7e-4e15-b788-6d4e3e06b130 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:05.454742 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1d34e3aa-7d7e-4e15-b788-6d4e3e06b130 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:05.456232 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1d34e3aa-7d7e-4e15-b788-6d4e3e06b130 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:05.458338 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1d34e3aa-7d7e-4e15-b788-6d4e3e06b130 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1752 microversion: 2.20 time: 0.164278 Aug 30 05:15:05.462851 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 228/472] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:05 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:15:05.794439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-37ffbff2-8d46-4803-bf2e-333901ce8e59 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:05.795091 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-37ffbff2-8d46-4803-bf2e-333901ce8e59 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:05.801708 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37ffbff2-8d46-4803-bf2e-333901ce8e59 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:05.802190 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37ffbff2-8d46-4803-bf2e-333901ce8e59 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:05.802627 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37ffbff2-8d46-4803-bf2e-333901ce8e59 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:05.803348 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37ffbff2-8d46-4803-bf2e-333901ce8e59 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:05.803804 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37ffbff2-8d46-4803-bf2e-333901ce8e59 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:05.804230 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37ffbff2-8d46-4803-bf2e-333901ce8e59 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:05.821828 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:05.934408 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-37ffbff2-8d46-4803-bf2e-333901ce8e59 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:05.942076 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-37ffbff2-8d46-4803-bf2e-333901ce8e59 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1513 microversion: 2.1 time: 0.151478 Aug 30 05:15:05.942633 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 245/473] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:05 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:06.405321 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-40f82403-48ed-4f38-af84-ece70c290daf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:06.405936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-40f82403-48ed-4f38-af84-ece70c290daf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:06.412746 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40f82403-48ed-4f38-af84-ece70c290daf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:06.413296 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40f82403-48ed-4f38-af84-ece70c290daf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:06.413748 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40f82403-48ed-4f38-af84-ece70c290daf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:06.414452 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40f82403-48ed-4f38-af84-ece70c290daf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:06.414940 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40f82403-48ed-4f38-af84-ece70c290daf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:06.415372 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-40f82403-48ed-4f38-af84-ece70c290daf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:06.484529 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2bcb9698-27a7-412d-a07e-3458692fc743 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:06.485544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2bcb9698-27a7-412d-a07e-3458692fc743 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:06.494932 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bcb9698-27a7-412d-a07e-3458692fc743 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:06.505119 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bcb9698-27a7-412d-a07e-3458692fc743 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:06.505718 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bcb9698-27a7-412d-a07e-3458692fc743 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:06.506456 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bcb9698-27a7-412d-a07e-3458692fc743 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:06.507113 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bcb9698-27a7-412d-a07e-3458692fc743 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:06.507731 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bcb9698-27a7-412d-a07e-3458692fc743 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:06.665673 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2bcb9698-27a7-412d-a07e-3458692fc743 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:06.675803 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2bcb9698-27a7-412d-a07e-3458692fc743 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:06.677399 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2bcb9698-27a7-412d-a07e-3458692fc743 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:06.678743 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2bcb9698-27a7-412d-a07e-3458692fc743 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.198047 Aug 30 05:15:06.681975 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-40f82403-48ed-4f38-af84-ece70c290daf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:06.687893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 246/474] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:06 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:06.691283 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-40f82403-48ed-4f38-af84-ece70c290daf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1566 microversion: 2.1 time: 0.289783 Aug 30 05:15:06.693556 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 229/475] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:06 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1566 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:06.712900 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-589de001-a592-4279-b96d-b816177188c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:06.713554 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-589de001-a592-4279-b96d-b816177188c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:06.719737 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-589de001-a592-4279-b96d-b816177188c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:06.720221 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-589de001-a592-4279-b96d-b816177188c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:06.720659 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-589de001-a592-4279-b96d-b816177188c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:06.721474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-589de001-a592-4279-b96d-b816177188c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:06.721931 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-589de001-a592-4279-b96d-b816177188c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:06.722356 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-589de001-a592-4279-b96d-b816177188c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:06.807469 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-589de001-a592-4279-b96d-b816177188c1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098339 Aug 30 05:15:06.808063 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 247/476] 10.222.0.77 () {58 vars in 1275 bytes} [Tue Aug 30 05:15:06 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:06.965615 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6a49c0d0-e2f4-42cb-8fc0-0e580eb58d1a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:06.966299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6a49c0d0-e2f4-42cb-8fc0-0e580eb58d1a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:06.972966 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a49c0d0-e2f4-42cb-8fc0-0e580eb58d1a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:06.973484 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a49c0d0-e2f4-42cb-8fc0-0e580eb58d1a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:06.974349 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a49c0d0-e2f4-42cb-8fc0-0e580eb58d1a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:06.975082 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a49c0d0-e2f4-42cb-8fc0-0e580eb58d1a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:06.975544 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a49c0d0-e2f4-42cb-8fc0-0e580eb58d1a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:06.975967 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6a49c0d0-e2f4-42cb-8fc0-0e580eb58d1a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:06.984215 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-a1468a83-00c0-4238-8373-8447ad4d16fe req-e19a6866-c9b0-44a0-bb58-f483cdd61226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48af496a-2b9e-4b18-aad8-59e43cfa075b", "name": "network-vif-deleted", "tag": "b0c9e9dd-7bc1-4662-8798-666b8b9584c8"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:06.998198 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-a1468a83-00c0-4238-8373-8447ad4d16fe req-e19a6866-c9b0-44a0-bb58-f483cdd61226 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:06.998640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-a1468a83-00c0-4238-8373-8447ad4d16fe req-e19a6866-c9b0-44a0-bb58-f483cdd61226 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:06.999289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-a1468a83-00c0-4238-8373-8447ad4d16fe req-e19a6866-c9b0-44a0-bb58-f483cdd61226 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:07.022348 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-a1468a83-00c0-4238-8373-8447ad4d16fe req-e19a6866-c9b0-44a0-bb58-f483cdd61226 service nova] Creating event network-vif-deleted:b0c9e9dd-7bc1-4662-8798-666b8b9584c8 for instance 48af496a-2b9e-4b18-aad8-59e43cfa075b on hv-cinder-85391 Aug 30 05:15:07.032861 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-a1468a83-00c0-4238-8373-8447ad4d16fe req-e19a6866-c9b0-44a0-bb58-f483cdd61226 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052361 Aug 30 05:15:07.033476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 248/477] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:07.097384 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6a49c0d0-e2f4-42cb-8fc0-0e580eb58d1a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:07.112043 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6a49c0d0-e2f4-42cb-8fc0-0e580eb58d1a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 200 len: 1471 microversion: 2.1 time: 0.152490 Aug 30 05:15:07.112638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 230/478] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:06 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:07.702388 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-68872fa1-72a3-4341-8300-a3b881c797b7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:07.703101 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-68872fa1-72a3-4341-8300-a3b881c797b7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:07.714670 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68872fa1-72a3-4341-8300-a3b881c797b7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:07.715119 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68872fa1-72a3-4341-8300-a3b881c797b7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:07.715548 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68872fa1-72a3-4341-8300-a3b881c797b7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:07.716259 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68872fa1-72a3-4341-8300-a3b881c797b7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:07.716718 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68872fa1-72a3-4341-8300-a3b881c797b7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:07.717151 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-68872fa1-72a3-4341-8300-a3b881c797b7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:07.972014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-68872fa1-72a3-4341-8300-a3b881c797b7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:07.983173 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-68872fa1-72a3-4341-8300-a3b881c797b7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:07.984611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-68872fa1-72a3-4341-8300-a3b881c797b7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:07.986102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-68872fa1-72a3-4341-8300-a3b881c797b7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.288331 Aug 30 05:15:07.986655 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 249/479] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:07 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:08.133809 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-908d4d95-6f60-4a59-aa14-99bb997ecf02 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:08.134600 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-908d4d95-6f60-4a59-aa14-99bb997ecf02 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 48af496a-2b9e-4b18-aad8-59e43cfa075b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:08.146494 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-908d4d95-6f60-4a59-aa14-99bb997ecf02 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:08.151814 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-908d4d95-6f60-4a59-aa14-99bb997ecf02 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:08.152270 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-908d4d95-6f60-4a59-aa14-99bb997ecf02 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:08.153007 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-908d4d95-6f60-4a59-aa14-99bb997ecf02 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:08.153468 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-908d4d95-6f60-4a59-aa14-99bb997ecf02 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:08.153883 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-908d4d95-6f60-4a59-aa14-99bb997ecf02 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:08.157287 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-662172d6-36a4-434b-a196-777be990567a req-318500bf-34c3-43e1-86a1-506569d1e887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30714902-9da4-4ee8-8cb1-bd37f13ce234", "tag": "361c8508-8cc9-4e2d-95e0-07af85e45dfa"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:08.172112 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-908d4d95-6f60-4a59-aa14-99bb997ecf02 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] HTTP exception thrown: Instance 48af496a-2b9e-4b18-aad8-59e43cfa075b could not be found. Aug 30 05:15:08.172866 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-662172d6-36a4-434b-a196-777be990567a req-318500bf-34c3-43e1-86a1-506569d1e887 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:08.173346 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-662172d6-36a4-434b-a196-777be990567a req-318500bf-34c3-43e1-86a1-506569d1e887 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:08.173769 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-662172d6-36a4-434b-a196-777be990567a req-318500bf-34c3-43e1-86a1-506569d1e887 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-908d4d95-6f60-4a59-aa14-99bb997ecf02 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Request method failure captured: Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b HTTP/1.1 Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZyKskjo2eDxOI5o0ltLNJGbqKI4ItjIeggZtsHnc0S6jFeBCfmc0dmrxgByUhOA5KHYkmW8HCiXMGooxpLr7b5c0Ym83oKFdkRq8skfWOgRVIXePAklyAA_X7kkrfqzCItcG8Ep9yUF-qJirs9dP2en1Xv70xg_3giM3A7_wSm-9j4 Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: d98f56be5fb14ebe9e938ebc0f642994 Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesSnapshotTestJSON-874921642 Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:15:08.173895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:15:08.175438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/d98f56be5fb14ebe9e938ebc0f642994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/d98f56be5fb14ebe9e938ebc0f642994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/d98f56be5fb14ebe9e938ebc0f642994"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_d98f56be5fb14ebe9e938ebc0f642994", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:15:08.175438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesSnapshotTestJSON-874921642 Aug 30 05:15:08.175438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: d98f56be5fb14ebe9e938ebc0f642994 Aug 30 05:15:08.175438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-874921642 Aug 30 05:15:08.175438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesSnapshotTestJSON-874921642-project Aug 30 05:15:08.175438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:15:08.175438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:15:08.175438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: 7522bcceac404e8aa10f719507fe1436 Aug 30 05:15:08.175438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesSnapshotTestJSON-874921642-project Aug 30 05:15:08.175438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:15:08.175438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance 48af496a-2b9e-4b18-aad8-59e43cfa075b could not be found. Aug 30 05:15:08.175438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': '48af496a-2b9e-4b18-aad8-59e43cfa075b'} Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48af496a-2b9e-4b18-aad8-59e43cfa075b could not be found. Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:15:08.176420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48af496a-2b9e-4b18-aad8-59e43cfa075b could not be found. Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48af496a-2b9e-4b18-aad8-59e43cfa075b could not be found. Aug 30 05:15:08.177840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:15:08.179073 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-908d4d95-6f60-4a59-aa14-99bb997ecf02 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Returning 404 to user: Instance 48af496a-2b9e-4b18-aad8-59e43cfa075b could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:15:08.179073 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-908d4d95-6f60-4a59-aa14-99bb997ecf02 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b" status: 404 len: 111 microversion: 2.1 time: 0.046518 Aug 30 05:15:08.181564 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 231/480] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:08 2022] GET /compute/v2.1/servers/48af496a-2b9e-4b18-aad8-59e43cfa075b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:15:08.202419 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-662172d6-36a4-434b-a196-777be990567a req-318500bf-34c3-43e1-86a1-506569d1e887 service nova] Creating event network-changed:361c8508-8cc9-4e2d-95e0-07af85e45dfa for instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 on hv-cinder-85391 Aug 30 05:15:08.221568 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-662172d6-36a4-434b-a196-777be990567a req-318500bf-34c3-43e1-86a1-506569d1e887 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067381 Aug 30 05:15:08.222045 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 250/481] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:09.009667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a1616cdd-8137-41cc-bfeb-ccfe013e3740 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:09.010366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a1616cdd-8137-41cc-bfeb-ccfe013e3740 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:09.016962 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1616cdd-8137-41cc-bfeb-ccfe013e3740 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:09.017595 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1616cdd-8137-41cc-bfeb-ccfe013e3740 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:09.018134 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1616cdd-8137-41cc-bfeb-ccfe013e3740 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:09.018989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1616cdd-8137-41cc-bfeb-ccfe013e3740 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:09.019546 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1616cdd-8137-41cc-bfeb-ccfe013e3740 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:09.020746 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a1616cdd-8137-41cc-bfeb-ccfe013e3740 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:09.194946 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a1616cdd-8137-41cc-bfeb-ccfe013e3740 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:09.206635 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a1616cdd-8137-41cc-bfeb-ccfe013e3740 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:09.208952 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a1616cdd-8137-41cc-bfeb-ccfe013e3740 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:09.210148 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a1616cdd-8137-41cc-bfeb-ccfe013e3740 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.204492 Aug 30 05:15:09.211399 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 232/482] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:09 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:10.234623 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c01a21be-4f61-40a1-9cf8-8a9b45746fca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:10.235344 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c01a21be-4f61-40a1-9cf8-8a9b45746fca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:10.242454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c01a21be-4f61-40a1-9cf8-8a9b45746fca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:10.246865 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c01a21be-4f61-40a1-9cf8-8a9b45746fca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:10.246865 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c01a21be-4f61-40a1-9cf8-8a9b45746fca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:10.246865 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c01a21be-4f61-40a1-9cf8-8a9b45746fca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:10.246865 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c01a21be-4f61-40a1-9cf8-8a9b45746fca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:10.247320 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c01a21be-4f61-40a1-9cf8-8a9b45746fca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:10.384480 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c01a21be-4f61-40a1-9cf8-8a9b45746fca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:10.394550 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c01a21be-4f61-40a1-9cf8-8a9b45746fca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:10.396054 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c01a21be-4f61-40a1-9cf8-8a9b45746fca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:10.397227 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c01a21be-4f61-40a1-9cf8-8a9b45746fca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.167341 Aug 30 05:15:10.397782 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 251/483] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:10 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:11.423225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-21a1b88e-a4c3-48ea-98e0-eb8288cb055e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:11.424554 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-21a1b88e-a4c3-48ea-98e0-eb8288cb055e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:11.432868 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21a1b88e-a4c3-48ea-98e0-eb8288cb055e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:11.433650 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21a1b88e-a4c3-48ea-98e0-eb8288cb055e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:11.434307 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21a1b88e-a4c3-48ea-98e0-eb8288cb055e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:11.435276 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21a1b88e-a4c3-48ea-98e0-eb8288cb055e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:11.435937 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21a1b88e-a4c3-48ea-98e0-eb8288cb055e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:11.436563 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21a1b88e-a4c3-48ea-98e0-eb8288cb055e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:11.595175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-21a1b88e-a4c3-48ea-98e0-eb8288cb055e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:11.605402 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-21a1b88e-a4c3-48ea-98e0-eb8288cb055e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:11.607011 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-21a1b88e-a4c3-48ea-98e0-eb8288cb055e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:11.608459 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-21a1b88e-a4c3-48ea-98e0-eb8288cb055e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.191427 Aug 30 05:15:11.623216 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 233/484] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:11 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:12.634424 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-975c2ca8-d440-49ee-b120-601925566b6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:12.635153 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-975c2ca8-d440-49ee-b120-601925566b6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:12.641829 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-975c2ca8-d440-49ee-b120-601925566b6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:12.642654 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-975c2ca8-d440-49ee-b120-601925566b6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:12.643422 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-975c2ca8-d440-49ee-b120-601925566b6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:12.644143 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-975c2ca8-d440-49ee-b120-601925566b6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:12.644601 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-975c2ca8-d440-49ee-b120-601925566b6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:12.645093 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-975c2ca8-d440-49ee-b120-601925566b6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:12.817803 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-975c2ca8-d440-49ee-b120-601925566b6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:12.829852 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-975c2ca8-d440-49ee-b120-601925566b6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:12.831313 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-975c2ca8-d440-49ee-b120-601925566b6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:12.832498 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-975c2ca8-d440-49ee-b120-601925566b6d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.203191 Aug 30 05:15:12.833285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 252/485] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:12 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:13.860129 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-21db5b36-19f7-4633-a1b4-0c38baa5d320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:13.861900 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-21db5b36-19f7-4633-a1b4-0c38baa5d320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:13.869690 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21db5b36-19f7-4633-a1b4-0c38baa5d320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:13.870173 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21db5b36-19f7-4633-a1b4-0c38baa5d320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:13.870603 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21db5b36-19f7-4633-a1b4-0c38baa5d320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:13.872515 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21db5b36-19f7-4633-a1b4-0c38baa5d320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:13.872515 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21db5b36-19f7-4633-a1b4-0c38baa5d320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:13.872515 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-21db5b36-19f7-4633-a1b4-0c38baa5d320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:14.043255 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-21db5b36-19f7-4633-a1b4-0c38baa5d320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:14.057206 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-21db5b36-19f7-4633-a1b4-0c38baa5d320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:14.059926 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-21db5b36-19f7-4633-a1b4-0c38baa5d320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:14.061427 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-21db5b36-19f7-4633-a1b4-0c38baa5d320 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.206218 Aug 30 05:15:14.075574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 234/486] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:13 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:15.084743 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b111164-6a49-48d2-ba4f-221458f41634 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:15.085352 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8b111164-6a49-48d2-ba4f-221458f41634 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:15.091800 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b111164-6a49-48d2-ba4f-221458f41634 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:15.092286 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b111164-6a49-48d2-ba4f-221458f41634 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:15.092971 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b111164-6a49-48d2-ba4f-221458f41634 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:15.093667 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b111164-6a49-48d2-ba4f-221458f41634 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:15.094113 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b111164-6a49-48d2-ba4f-221458f41634 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:15.094534 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b111164-6a49-48d2-ba4f-221458f41634 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:15.237790 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b111164-6a49-48d2-ba4f-221458f41634 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:15.246753 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b111164-6a49-48d2-ba4f-221458f41634 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:15.248200 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8b111164-6a49-48d2-ba4f-221458f41634 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:15.249349 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8b111164-6a49-48d2-ba4f-221458f41634 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.168598 Aug 30 05:15:15.249901 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 253/487] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:15 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:16.272564 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b6b6a4cb-9c57-4723-bac6-723aba0d00a4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:16.274015 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b6b6a4cb-9c57-4723-bac6-723aba0d00a4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:16.281218 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6b6a4cb-9c57-4723-bac6-723aba0d00a4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:16.282039 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6b6a4cb-9c57-4723-bac6-723aba0d00a4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:16.282540 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6b6a4cb-9c57-4723-bac6-723aba0d00a4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:16.283465 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6b6a4cb-9c57-4723-bac6-723aba0d00a4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:16.284021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6b6a4cb-9c57-4723-bac6-723aba0d00a4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:16.284547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b6b6a4cb-9c57-4723-bac6-723aba0d00a4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:16.423599 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b6b6a4cb-9c57-4723-bac6-723aba0d00a4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:16.433198 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b6b6a4cb-9c57-4723-bac6-723aba0d00a4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:16.434652 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b6b6a4cb-9c57-4723-bac6-723aba0d00a4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:16.435872 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b6b6a4cb-9c57-4723-bac6-723aba0d00a4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.167286 Aug 30 05:15:16.436791 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 235/488] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:16 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:17.458707 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9d4cbbd4-53bf-462a-9f59-946339c0ae85 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:17.459357 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9d4cbbd4-53bf-462a-9f59-946339c0ae85 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:17.461800 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=62 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:17.467907 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d4cbbd4-53bf-462a-9f59-946339c0ae85 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:17.469342 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d4cbbd4-53bf-462a-9f59-946339c0ae85 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:17.469788 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d4cbbd4-53bf-462a-9f59-946339c0ae85 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:17.470494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d4cbbd4-53bf-462a-9f59-946339c0ae85 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:17.470985 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d4cbbd4-53bf-462a-9f59-946339c0ae85 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:17.471449 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9d4cbbd4-53bf-462a-9f59-946339c0ae85 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:17.604281 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9d4cbbd4-53bf-462a-9f59-946339c0ae85 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:17.613086 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9d4cbbd4-53bf-462a-9f59-946339c0ae85 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:17.614537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9d4cbbd4-53bf-462a-9f59-946339c0ae85 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:17.615733 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9d4cbbd4-53bf-462a-9f59-946339c0ae85 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.161647 Aug 30 05:15:17.616289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 254/489] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:17 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:18.344248 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-787026385", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452", "networks": [{"uuid": "fc212efd-2a77-4199-8dbb-eb28c0903801"}]}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:18.400359 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] validate_networks() for [('fc212efd-2a77-4199-8dbb-eb28c0903801', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:15:18.638668 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2d0278b2-6d34-49ca-8150-3b06f3c489c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:18.639296 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2d0278b2-6d34-49ca-8150-3b06f3c489c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:18.645636 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d0278b2-6d34-49ca-8150-3b06f3c489c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:18.646309 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d0278b2-6d34-49ca-8150-3b06f3c489c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:18.646745 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d0278b2-6d34-49ca-8150-3b06f3c489c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:18.647473 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d0278b2-6d34-49ca-8150-3b06f3c489c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:18.647925 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d0278b2-6d34-49ca-8150-3b06f3c489c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:18.648344 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2d0278b2-6d34-49ca-8150-3b06f3c489c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:18.743911 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:15:18.744335 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:15:18.744809 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:15:18.745218 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:15:18.745665 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:15:18.754436 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:18.754963 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:18.755402 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:18.756134 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:18.756587 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:18.757014 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:18.763772 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:18.777407 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2d0278b2-6d34-49ca-8150-3b06f3c489c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:18.777876 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Getting quotas for project d98f56be5fb14ebe9e938ebc0f642994. Resources: {'instances', 'ram', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:15:18.782205 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Getting quotas for user 7522bcceac404e8aa10f719507fe1436 and project d98f56be5fb14ebe9e938ebc0f642994. Resources: {'instances', 'ram', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:15:18.786486 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2d0278b2-6d34-49ca-8150-3b06f3c489c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:18.787953 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2d0278b2-6d34-49ca-8150-3b06f3c489c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:18.789107 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2d0278b2-6d34-49ca-8150-3b06f3c489c2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.154325 Aug 30 05:15:18.789883 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 255/490] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:18 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:15:18.793880 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:15:18.796280 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:15:18.842411 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f75ed644-4aa0-43e9-bb4f-5c3bbcc4430e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502204 Aug 30 05:15:18.843356 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 236/491] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:15:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:15:18.854409 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f0db6016-d6f5-4263-a316-1ddca99db65a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:18.855046 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f0db6016-d6f5-4263-a316-1ddca99db65a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:18.909622 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f0db6016-d6f5-4263-a316-1ddca99db65a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:18.916985 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f0db6016-d6f5-4263-a316-1ddca99db65a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 200 len: 1218 microversion: 2.1 time: 0.066322 Aug 30 05:15:18.917553 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 256/492] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:18 2022] GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:19.812536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-786442e4-eccf-4d9f-b73a-10fbf4ac8307 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:19.813152 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-786442e4-eccf-4d9f-b73a-10fbf4ac8307 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:19.820366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-786442e4-eccf-4d9f-b73a-10fbf4ac8307 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:19.820851 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-786442e4-eccf-4d9f-b73a-10fbf4ac8307 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:19.821277 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-786442e4-eccf-4d9f-b73a-10fbf4ac8307 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:19.821969 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-786442e4-eccf-4d9f-b73a-10fbf4ac8307 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:19.822423 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-786442e4-eccf-4d9f-b73a-10fbf4ac8307 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:19.822872 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-786442e4-eccf-4d9f-b73a-10fbf4ac8307 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:19.937500 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5b8256a7-10cd-46b6-a4c2-ef20b1524e0c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:19.938105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5b8256a7-10cd-46b6-a4c2-ef20b1524e0c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:19.945139 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8256a7-10cd-46b6-a4c2-ef20b1524e0c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:19.945626 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8256a7-10cd-46b6-a4c2-ef20b1524e0c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:19.946061 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8256a7-10cd-46b6-a4c2-ef20b1524e0c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:19.949260 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-786442e4-eccf-4d9f-b73a-10fbf4ac8307 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:19.951520 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8256a7-10cd-46b6-a4c2-ef20b1524e0c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:19.952201 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8256a7-10cd-46b6-a4c2-ef20b1524e0c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:19.952739 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b8256a7-10cd-46b6-a4c2-ef20b1524e0c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:19.958654 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-786442e4-eccf-4d9f-b73a-10fbf4ac8307 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:19.960262 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-786442e4-eccf-4d9f-b73a-10fbf4ac8307 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:19.961433 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-786442e4-eccf-4d9f-b73a-10fbf4ac8307 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.153276 Aug 30 05:15:19.975815 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 237/493] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:19 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:20.022141 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5b8256a7-10cd-46b6-a4c2-ef20b1524e0c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:20.030072 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5b8256a7-10cd-46b6-a4c2-ef20b1524e0c tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 200 len: 1270 microversion: 2.1 time: 0.096433 Aug 30 05:15:20.030908 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 257/494] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:19 2022] GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:15:20.426379 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-892332881", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1477137281", "security_groups": [{"name": "tempest-secgroup-smoke-21014458"}], "block_device_mapping_v2": [{"uuid": "da47d600-fea3-48cd-8d22-92e7893b5941", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "15c65eeb-dfe2-43bb-9925-99f6c334ef61"}]}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:20.565793 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] validate_networks() for [('15c65eeb-dfe2-43bb-9925-99f6c334ef61', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:15:20.985553 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4f6ae5bc-b5b7-4e0c-978f-2404ae4a58c3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:20.986266 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4f6ae5bc-b5b7-4e0c-978f-2404ae4a58c3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:20.993490 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f6ae5bc-b5b7-4e0c-978f-2404ae4a58c3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:20.993950 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f6ae5bc-b5b7-4e0c-978f-2404ae4a58c3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:20.994469 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f6ae5bc-b5b7-4e0c-978f-2404ae4a58c3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:20.995394 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f6ae5bc-b5b7-4e0c-978f-2404ae4a58c3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:20.995847 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f6ae5bc-b5b7-4e0c-978f-2404ae4a58c3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:20.996521 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4f6ae5bc-b5b7-4e0c-978f-2404ae4a58c3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:21.133065 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4f6ae5bc-b5b7-4e0c-978f-2404ae4a58c3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:21.141682 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4f6ae5bc-b5b7-4e0c-978f-2404ae4a58c3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:21.143164 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4f6ae5bc-b5b7-4e0c-978f-2404ae4a58c3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:21.144332 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4f6ae5bc-b5b7-4e0c-978f-2404ae4a58c3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.162656 Aug 30 05:15:21.144887 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 258/495] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:20 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:21.149549 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-38460cdb-69f9-4c7d-b1af-b8c66ce05329 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:21.150196 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-38460cdb-69f9-4c7d-b1af-b8c66ce05329 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:21.156870 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38460cdb-69f9-4c7d-b1af-b8c66ce05329 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:21.158043 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38460cdb-69f9-4c7d-b1af-b8c66ce05329 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:21.158408 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38460cdb-69f9-4c7d-b1af-b8c66ce05329 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:21.159412 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38460cdb-69f9-4c7d-b1af-b8c66ce05329 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:21.159606 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38460cdb-69f9-4c7d-b1af-b8c66ce05329 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:21.160033 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-38460cdb-69f9-4c7d-b1af-b8c66ce05329 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:21.199728 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:15:21.200229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:15:21.200821 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:15:21.201528 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:15:21.204403 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:15:21.211001 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:21.211717 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:21.212225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:21.213067 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:21.213605 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:21.214532 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:21.232503 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Getting quotas for project 97e3452b02294219ae56cd23eb2aa0ce. Resources: {'instances', 'ram', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:15:21.236629 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Getting quotas for user 9256fd43e5124fb68d4e5453584d1e8d and project 97e3452b02294219ae56cd23eb2aa0ce. Resources: {'instances', 'ram', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:15:21.300156 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-38460cdb-69f9-4c7d-b1af-b8c66ce05329 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:21.305085 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:15:21.307174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da47d600-fea3-48cd-8d22-92e7893b5941',volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:15:21.309532 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-38460cdb-69f9-4c7d-b1af-b8c66ce05329 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 200 len: 1318 microversion: 2.1 time: 0.163285 Aug 30 05:15:21.310120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 259/496] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:21 2022] GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:21.443007 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d77855d3-666b-4896-8059-9d67388050a1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.020437 Aug 30 05:15:21.443857 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 238/497] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:15:20 2022] POST /compute/v2.1/servers => generated 404 bytes in 1022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:15:21.454802 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-16b1e95c-05c3-4c60-892d-6083baedc685 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:21.455957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-16b1e95c-05c3-4c60-892d-6083baedc685 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:21.532369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-16b1e95c-05c3-4c60-892d-6083baedc685 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:21.542113 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-16b1e95c-05c3-4c60-892d-6083baedc685 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1094 microversion: 2.1 time: 0.091632 Aug 30 05:15:21.543266 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 260/498] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:21 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1094 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:21.749435 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-e11f6084-4921-43ba-9028-a22814d9c26d req-1cae8ace-c711-491d-a462-e785fe269576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f137b0e-9fb0-41ce-8bfa-a42616c11576", "tag": "2315c25e-223b-4438-add1-64c8835a4abc"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:21.774532 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:21.777135 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-e11f6084-4921-43ba-9028-a22814d9c26d req-1cae8ace-c711-491d-a462-e785fe269576 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:21.777940 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-e11f6084-4921-43ba-9028-a22814d9c26d req-1cae8ace-c711-491d-a462-e785fe269576 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:21.778575 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-e11f6084-4921-43ba-9028-a22814d9c26d req-1cae8ace-c711-491d-a462-e785fe269576 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:21.791747 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-e11f6084-4921-43ba-9028-a22814d9c26d req-1cae8ace-c711-491d-a462-e785fe269576 service nova] Creating event network-changed:2315c25e-223b-4438-add1-64c8835a4abc for instance 1f137b0e-9fb0-41ce-8bfa-a42616c11576 on hv-cinder-85391 Aug 30 05:15:21.797079 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-e11f6084-4921-43ba-9028-a22814d9c26d req-1cae8ace-c711-491d-a462-e785fe269576 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053320 Aug 30 05:15:21.797964 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 239/499] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:22.166483 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6ae3ada0-45d0-4b7f-a09b-d633fd63b583 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:22.167117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6ae3ada0-45d0-4b7f-a09b-d633fd63b583 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:22.175715 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6ae3ada0-45d0-4b7f-a09b-d633fd63b583 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:22.176203 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6ae3ada0-45d0-4b7f-a09b-d633fd63b583 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:22.176655 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6ae3ada0-45d0-4b7f-a09b-d633fd63b583 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:22.177538 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6ae3ada0-45d0-4b7f-a09b-d633fd63b583 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:22.177856 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6ae3ada0-45d0-4b7f-a09b-d633fd63b583 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:22.178314 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6ae3ada0-45d0-4b7f-a09b-d633fd63b583 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:22.307260 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6ae3ada0-45d0-4b7f-a09b-d633fd63b583 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:22.315823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6ae3ada0-45d0-4b7f-a09b-d633fd63b583 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:22.317762 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6ae3ada0-45d0-4b7f-a09b-d633fd63b583 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:22.318938 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6ae3ada0-45d0-4b7f-a09b-d633fd63b583 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.156256 Aug 30 05:15:22.319501 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 261/500] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:22 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:22.334105 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a446e5c4-c80d-4316-a6dc-5a6752095b58 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:22.334797 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a446e5c4-c80d-4316-a6dc-5a6752095b58 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:22.340852 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a446e5c4-c80d-4316-a6dc-5a6752095b58 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:22.341351 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a446e5c4-c80d-4316-a6dc-5a6752095b58 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:22.341784 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a446e5c4-c80d-4316-a6dc-5a6752095b58 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:22.342462 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a446e5c4-c80d-4316-a6dc-5a6752095b58 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:22.343196 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a446e5c4-c80d-4316-a6dc-5a6752095b58 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:22.343617 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a446e5c4-c80d-4316-a6dc-5a6752095b58 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:22.472439 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a446e5c4-c80d-4316-a6dc-5a6752095b58 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:22.479932 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a446e5c4-c80d-4316-a6dc-5a6752095b58 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 200 len: 1318 microversion: 2.1 time: 0.151474 Aug 30 05:15:22.480496 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 240/501] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:22 2022] GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:22.563100 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d0868807-abcf-407c-925a-c11fa1b5d070 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:22.563822 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d0868807-abcf-407c-925a-c11fa1b5d070 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:22.570372 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0868807-abcf-407c-925a-c11fa1b5d070 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:22.570873 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0868807-abcf-407c-925a-c11fa1b5d070 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:22.571309 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0868807-abcf-407c-925a-c11fa1b5d070 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:22.571997 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0868807-abcf-407c-925a-c11fa1b5d070 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:22.572449 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0868807-abcf-407c-925a-c11fa1b5d070 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:22.572873 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d0868807-abcf-407c-925a-c11fa1b5d070 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:22.632815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d0868807-abcf-407c-925a-c11fa1b5d070 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:22.640389 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d0868807-abcf-407c-925a-c11fa1b5d070 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1192 microversion: 2.1 time: 0.081442 Aug 30 05:15:22.640957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 262/502] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:22 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1192 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:23.341355 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bc2870b4-e397-4dc5-b781-dfd5dc02c3c6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:23.341972 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bc2870b4-e397-4dc5-b781-dfd5dc02c3c6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:23.348515 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc2870b4-e397-4dc5-b781-dfd5dc02c3c6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:23.349001 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc2870b4-e397-4dc5-b781-dfd5dc02c3c6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:23.350100 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc2870b4-e397-4dc5-b781-dfd5dc02c3c6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:23.350793 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc2870b4-e397-4dc5-b781-dfd5dc02c3c6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:23.351276 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc2870b4-e397-4dc5-b781-dfd5dc02c3c6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:23.351702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bc2870b4-e397-4dc5-b781-dfd5dc02c3c6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:23.500902 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ff7b0eec-cab1-4aac-b3b0-54f39eddfc88 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:23.501520 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ff7b0eec-cab1-4aac-b3b0-54f39eddfc88 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:23.507886 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bc2870b4-e397-4dc5-b781-dfd5dc02c3c6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:23.508620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff7b0eec-cab1-4aac-b3b0-54f39eddfc88 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:23.509106 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff7b0eec-cab1-4aac-b3b0-54f39eddfc88 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:23.509542 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff7b0eec-cab1-4aac-b3b0-54f39eddfc88 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:23.510236 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff7b0eec-cab1-4aac-b3b0-54f39eddfc88 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:23.510698 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff7b0eec-cab1-4aac-b3b0-54f39eddfc88 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:23.511153 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ff7b0eec-cab1-4aac-b3b0-54f39eddfc88 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:23.516563 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bc2870b4-e397-4dc5-b781-dfd5dc02c3c6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:23.518065 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-bc2870b4-e397-4dc5-b781-dfd5dc02c3c6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:23.519256 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bc2870b4-e397-4dc5-b781-dfd5dc02c3c6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.181729 Aug 30 05:15:23.519816 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 241/503] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:23 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:23.644553 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ff7b0eec-cab1-4aac-b3b0-54f39eddfc88 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:23.652792 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ff7b0eec-cab1-4aac-b3b0-54f39eddfc88 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 200 len: 1318 microversion: 2.1 time: 0.155771 Aug 30 05:15:23.653364 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 263/504] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:23 2022] GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:23.671937 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-764601e8-fa2e-4f29-a853-d56409e7cf19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:23.672550 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-764601e8-fa2e-4f29-a853-d56409e7cf19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:23.679036 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-764601e8-fa2e-4f29-a853-d56409e7cf19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:23.680187 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-764601e8-fa2e-4f29-a853-d56409e7cf19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:23.680705 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-764601e8-fa2e-4f29-a853-d56409e7cf19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:23.681411 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-764601e8-fa2e-4f29-a853-d56409e7cf19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:23.681867 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-764601e8-fa2e-4f29-a853-d56409e7cf19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:23.682288 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-764601e8-fa2e-4f29-a853-d56409e7cf19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:23.751845 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-764601e8-fa2e-4f29-a853-d56409e7cf19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:23.759461 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-764601e8-fa2e-4f29-a853-d56409e7cf19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1192 microversion: 2.1 time: 0.091557 Aug 30 05:15:23.760022 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 242/505] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:23 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:15:24.542416 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5ccd6131-c446-48f7-ab02-2bee41552d7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:24.543109 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5ccd6131-c446-48f7-ab02-2bee41552d7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:24.550367 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ccd6131-c446-48f7-ab02-2bee41552d7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:24.551398 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ccd6131-c446-48f7-ab02-2bee41552d7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:24.551398 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ccd6131-c446-48f7-ab02-2bee41552d7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:24.552034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ccd6131-c446-48f7-ab02-2bee41552d7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:24.552487 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ccd6131-c446-48f7-ab02-2bee41552d7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:24.552903 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5ccd6131-c446-48f7-ab02-2bee41552d7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:24.674234 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-65be67c4-6277-4410-b070-28f807960dfa tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:24.675041 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-65be67c4-6277-4410-b070-28f807960dfa tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:24.681837 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65be67c4-6277-4410-b070-28f807960dfa tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:24.682401 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65be67c4-6277-4410-b070-28f807960dfa tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:24.683101 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65be67c4-6277-4410-b070-28f807960dfa tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:24.684010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65be67c4-6277-4410-b070-28f807960dfa tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:24.684732 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65be67c4-6277-4410-b070-28f807960dfa tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:24.685256 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-65be67c4-6277-4410-b070-28f807960dfa tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:24.690575 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5ccd6131-c446-48f7-ab02-2bee41552d7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:24.699848 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5ccd6131-c446-48f7-ab02-2bee41552d7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:24.701299 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5ccd6131-c446-48f7-ab02-2bee41552d7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:24.702693 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5ccd6131-c446-48f7-ab02-2bee41552d7a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.164874 Aug 30 05:15:24.703500 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 264/506] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:24 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:24.779844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-36ed62dd-5830-4588-80e3-4749be9aee3b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:24.780549 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-36ed62dd-5830-4588-80e3-4749be9aee3b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:24.786412 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36ed62dd-5830-4588-80e3-4749be9aee3b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:24.786932 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36ed62dd-5830-4588-80e3-4749be9aee3b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:24.787375 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36ed62dd-5830-4588-80e3-4749be9aee3b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:24.788064 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36ed62dd-5830-4588-80e3-4749be9aee3b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:24.788515 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36ed62dd-5830-4588-80e3-4749be9aee3b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:24.788941 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-36ed62dd-5830-4588-80e3-4749be9aee3b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:24.852128 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-36ed62dd-5830-4588-80e3-4749be9aee3b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:24.856320 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:24.861995 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-36ed62dd-5830-4588-80e3-4749be9aee3b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1210 microversion: 2.1 time: 0.086065 Aug 30 05:15:24.862668 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 265/507] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:24 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:15:24.937406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-65be67c4-6277-4410-b070-28f807960dfa tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:24.946079 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-65be67c4-6277-4410-b070-28f807960dfa tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 200 len: 1318 microversion: 2.1 time: 0.275608 Aug 30 05:15:24.947036 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 243/508] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:24 2022] GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:15:25.726714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-acf3b710-b15c-435d-8add-6acbb033dc4f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:25.727350 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-acf3b710-b15c-435d-8add-6acbb033dc4f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:25.733783 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acf3b710-b15c-435d-8add-6acbb033dc4f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:25.734268 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acf3b710-b15c-435d-8add-6acbb033dc4f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:25.734705 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acf3b710-b15c-435d-8add-6acbb033dc4f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:25.735432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acf3b710-b15c-435d-8add-6acbb033dc4f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:25.735881 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acf3b710-b15c-435d-8add-6acbb033dc4f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:25.736304 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-acf3b710-b15c-435d-8add-6acbb033dc4f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:25.867886 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-acf3b710-b15c-435d-8add-6acbb033dc4f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:25.876451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-acf3b710-b15c-435d-8add-6acbb033dc4f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:25.877890 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-acf3b710-b15c-435d-8add-6acbb033dc4f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:25.879489 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-acf3b710-b15c-435d-8add-6acbb033dc4f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.157705 Aug 30 05:15:25.880044 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 266/509] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:25 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:25.884519 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2eefe285-c639-4d9d-aa24-cae00f762554 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:25.885137 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2eefe285-c639-4d9d-aa24-cae00f762554 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:25.892264 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eefe285-c639-4d9d-aa24-cae00f762554 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:25.892756 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eefe285-c639-4d9d-aa24-cae00f762554 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:25.893560 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eefe285-c639-4d9d-aa24-cae00f762554 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:25.894458 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eefe285-c639-4d9d-aa24-cae00f762554 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:25.895214 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eefe285-c639-4d9d-aa24-cae00f762554 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:25.895840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2eefe285-c639-4d9d-aa24-cae00f762554 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:25.923534 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-36b8fe27-6c27-42b1-8e8d-492bab73881d req-91097b2d-4529-4cb3-841d-41e53e6bb674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6", "tag": "f08307cf-f44e-403c-bd63-0b7921eca530"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:25.935603 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-36b8fe27-6c27-42b1-8e8d-492bab73881d req-91097b2d-4529-4cb3-841d-41e53e6bb674 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:25.936073 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-36b8fe27-6c27-42b1-8e8d-492bab73881d req-91097b2d-4529-4cb3-841d-41e53e6bb674 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:25.936498 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-36b8fe27-6c27-42b1-8e8d-492bab73881d req-91097b2d-4529-4cb3-841d-41e53e6bb674 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:25.948280 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-36b8fe27-6c27-42b1-8e8d-492bab73881d req-91097b2d-4529-4cb3-841d-41e53e6bb674 service nova] Creating event network-changed:f08307cf-f44e-403c-bd63-0b7921eca530 for instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 on hv-cinder-85391 Aug 30 05:15:25.953559 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-36b8fe27-6c27-42b1-8e8d-492bab73881d req-91097b2d-4529-4cb3-841d-41e53e6bb674 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034671 Aug 30 05:15:25.954580 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 267/510] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:15:25.965910 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eb2ddaa2-0c3a-4f1a-af08-3a5098dc1a0a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:25.966593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eb2ddaa2-0c3a-4f1a-af08-3a5098dc1a0a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:25.973488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb2ddaa2-0c3a-4f1a-af08-3a5098dc1a0a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:25.973973 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb2ddaa2-0c3a-4f1a-af08-3a5098dc1a0a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:25.974449 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb2ddaa2-0c3a-4f1a-af08-3a5098dc1a0a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:25.975207 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb2ddaa2-0c3a-4f1a-af08-3a5098dc1a0a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:25.975657 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb2ddaa2-0c3a-4f1a-af08-3a5098dc1a0a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:25.976076 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb2ddaa2-0c3a-4f1a-af08-3a5098dc1a0a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:26.106844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-eb2ddaa2-0c3a-4f1a-af08-3a5098dc1a0a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:26.114369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eb2ddaa2-0c3a-4f1a-af08-3a5098dc1a0a tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 200 len: 1318 microversion: 2.1 time: 0.152350 Aug 30 05:15:26.114948 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 268/511] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:25 2022] GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:15:26.139641 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2eefe285-c639-4d9d-aa24-cae00f762554 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:26.147893 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2eefe285-c639-4d9d-aa24-cae00f762554 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1264 microversion: 2.1 time: 0.267853 Aug 30 05:15:26.148473 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 244/512] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:25 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1264 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:15:26.903064 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3c6e85f0-0fe9-4b6a-a1e1-94c1cf5fd30f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:26.903697 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3c6e85f0-0fe9-4b6a-a1e1-94c1cf5fd30f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:26.916827 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c6e85f0-0fe9-4b6a-a1e1-94c1cf5fd30f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:26.917327 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c6e85f0-0fe9-4b6a-a1e1-94c1cf5fd30f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:26.917784 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c6e85f0-0fe9-4b6a-a1e1-94c1cf5fd30f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:26.918709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c6e85f0-0fe9-4b6a-a1e1-94c1cf5fd30f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:26.919198 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c6e85f0-0fe9-4b6a-a1e1-94c1cf5fd30f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:26.919622 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3c6e85f0-0fe9-4b6a-a1e1-94c1cf5fd30f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:27.065202 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3c6e85f0-0fe9-4b6a-a1e1-94c1cf5fd30f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:27.073763 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3c6e85f0-0fe9-4b6a-a1e1-94c1cf5fd30f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:27.075221 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3c6e85f0-0fe9-4b6a-a1e1-94c1cf5fd30f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:27.076376 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3c6e85f0-0fe9-4b6a-a1e1-94c1cf5fd30f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.177730 Aug 30 05:15:27.076927 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 269/513] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:26 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:27.135108 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e590fa03-c19b-4b1f-a3ae-4d28b9a4e8cb tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:27.135722 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e590fa03-c19b-4b1f-a3ae-4d28b9a4e8cb tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:27.142109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e590fa03-c19b-4b1f-a3ae-4d28b9a4e8cb tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:27.142589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e590fa03-c19b-4b1f-a3ae-4d28b9a4e8cb tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:27.143072 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e590fa03-c19b-4b1f-a3ae-4d28b9a4e8cb tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:27.143765 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e590fa03-c19b-4b1f-a3ae-4d28b9a4e8cb tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:27.144214 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e590fa03-c19b-4b1f-a3ae-4d28b9a4e8cb tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:27.144633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e590fa03-c19b-4b1f-a3ae-4d28b9a4e8cb tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:27.170338 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8800a0b3-6dd1-41df-bb06-aecc39bbbe8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:27.170985 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8800a0b3-6dd1-41df-bb06-aecc39bbbe8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:27.176912 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8800a0b3-6dd1-41df-bb06-aecc39bbbe8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:27.177433 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8800a0b3-6dd1-41df-bb06-aecc39bbbe8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:27.177871 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8800a0b3-6dd1-41df-bb06-aecc39bbbe8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:27.178562 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8800a0b3-6dd1-41df-bb06-aecc39bbbe8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:27.179090 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8800a0b3-6dd1-41df-bb06-aecc39bbbe8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:27.179719 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8800a0b3-6dd1-41df-bb06-aecc39bbbe8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:27.273556 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e590fa03-c19b-4b1f-a3ae-4d28b9a4e8cb tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:27.281373 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e590fa03-c19b-4b1f-a3ae-4d28b9a4e8cb tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 200 len: 1318 microversion: 2.1 time: 0.150169 Aug 30 05:15:27.282004 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 245/514] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:27 2022] GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:27.322342 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8800a0b3-6dd1-41df-bb06-aecc39bbbe8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:27.329984 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8800a0b3-6dd1-41df-bb06-aecc39bbbe8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1264 microversion: 2.1 time: 0.164296 Aug 30 05:15:27.330547 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 270/515] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:27 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:28.100426 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d4a9d9a6-377c-485e-94e5-bb688330eef8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:28.101038 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d4a9d9a6-377c-485e-94e5-bb688330eef8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:28.106963 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4a9d9a6-377c-485e-94e5-bb688330eef8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:28.107448 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4a9d9a6-377c-485e-94e5-bb688330eef8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:28.107882 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4a9d9a6-377c-485e-94e5-bb688330eef8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:28.108569 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4a9d9a6-377c-485e-94e5-bb688330eef8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:28.109028 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4a9d9a6-377c-485e-94e5-bb688330eef8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:28.109451 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4a9d9a6-377c-485e-94e5-bb688330eef8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:28.237357 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d4a9d9a6-377c-485e-94e5-bb688330eef8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:28.246559 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d4a9d9a6-377c-485e-94e5-bb688330eef8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:28.248070 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d4a9d9a6-377c-485e-94e5-bb688330eef8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:28.249231 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d4a9d9a6-377c-485e-94e5-bb688330eef8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.153219 Aug 30 05:15:28.249785 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 246/516] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:28 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:28.301832 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b6b0fb6e-a261-4b91-a669-38c22416192f tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:28.303108 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b6b0fb6e-a261-4b91-a669-38c22416192f tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:28.309567 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6b0fb6e-a261-4b91-a669-38c22416192f tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:28.310039 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6b0fb6e-a261-4b91-a669-38c22416192f tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:28.310464 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6b0fb6e-a261-4b91-a669-38c22416192f tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:28.311170 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6b0fb6e-a261-4b91-a669-38c22416192f tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:28.311618 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6b0fb6e-a261-4b91-a669-38c22416192f tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:28.312036 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6b0fb6e-a261-4b91-a669-38c22416192f tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:28.351889 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-565ce184-32c2-4fa8-82e1-c953ab64cb56 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:28.352512 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-565ce184-32c2-4fa8-82e1-c953ab64cb56 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:28.358497 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-565ce184-32c2-4fa8-82e1-c953ab64cb56 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:28.359123 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-565ce184-32c2-4fa8-82e1-c953ab64cb56 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:28.359628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-565ce184-32c2-4fa8-82e1-c953ab64cb56 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:28.360385 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-565ce184-32c2-4fa8-82e1-c953ab64cb56 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:28.360916 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-565ce184-32c2-4fa8-82e1-c953ab64cb56 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:28.361408 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-565ce184-32c2-4fa8-82e1-c953ab64cb56 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:28.440748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b6b0fb6e-a261-4b91-a669-38c22416192f tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:28.448458 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b6b0fb6e-a261-4b91-a669-38c22416192f tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 200 len: 1318 microversion: 2.1 time: 0.150394 Aug 30 05:15:28.449022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 271/517] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:28 2022] GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:28.491671 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-565ce184-32c2-4fa8-82e1-c953ab64cb56 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:28.499086 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-565ce184-32c2-4fa8-82e1-c953ab64cb56 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1264 microversion: 2.1 time: 0.151558 Aug 30 05:15:28.499649 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 247/518] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:28 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:15:29.040443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-6894e68c-dd78-44b8-874b-0178689b1ae7 req-5401924c-567a-43a7-9d88-affb95025f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f137b0e-9fb0-41ce-8bfa-a42616c11576", "name": "network-vif-plugged", "status": "completed", "tag": "2315c25e-223b-4438-add1-64c8835a4abc"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:29.053533 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-6894e68c-dd78-44b8-874b-0178689b1ae7 req-5401924c-567a-43a7-9d88-affb95025f79 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:29.054318 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-6894e68c-dd78-44b8-874b-0178689b1ae7 req-5401924c-567a-43a7-9d88-affb95025f79 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:29.055055 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-6894e68c-dd78-44b8-874b-0178689b1ae7 req-5401924c-567a-43a7-9d88-affb95025f79 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:29.067071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-6894e68c-dd78-44b8-874b-0178689b1ae7 req-5401924c-567a-43a7-9d88-affb95025f79 service nova] Creating event network-vif-plugged:2315c25e-223b-4438-add1-64c8835a4abc for instance 1f137b0e-9fb0-41ce-8bfa-a42616c11576 on hv-cinder-85391 Aug 30 05:15:29.071773 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-6894e68c-dd78-44b8-874b-0178689b1ae7 req-5401924c-567a-43a7-9d88-affb95025f79 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035769 Aug 30 05:15:29.072354 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 272/519] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:29.273243 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2a7674b7-afb7-4449-9bc1-ce53d79728a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:29.273776 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2a7674b7-afb7-4449-9bc1-ce53d79728a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:29.280873 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a7674b7-afb7-4449-9bc1-ce53d79728a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:29.281444 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a7674b7-afb7-4449-9bc1-ce53d79728a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:29.282003 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a7674b7-afb7-4449-9bc1-ce53d79728a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:29.283060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a7674b7-afb7-4449-9bc1-ce53d79728a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:29.283585 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a7674b7-afb7-4449-9bc1-ce53d79728a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:29.284111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2a7674b7-afb7-4449-9bc1-ce53d79728a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:29.415763 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2a7674b7-afb7-4449-9bc1-ce53d79728a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:29.424432 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2a7674b7-afb7-4449-9bc1-ce53d79728a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:29.425874 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2a7674b7-afb7-4449-9bc1-ce53d79728a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:29.427069 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2a7674b7-afb7-4449-9bc1-ce53d79728a7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.159087 Aug 30 05:15:29.427627 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 248/520] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:29 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:29.470774 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f74b4692-0bd0-4fb8-b4e6-f6c9163dcce4 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:29.471518 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f74b4692-0bd0-4fb8-b4e6-f6c9163dcce4 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:29.478135 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f74b4692-0bd0-4fb8-b4e6-f6c9163dcce4 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:29.478606 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f74b4692-0bd0-4fb8-b4e6-f6c9163dcce4 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:29.479074 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f74b4692-0bd0-4fb8-b4e6-f6c9163dcce4 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:29.479753 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f74b4692-0bd0-4fb8-b4e6-f6c9163dcce4 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:29.480204 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f74b4692-0bd0-4fb8-b4e6-f6c9163dcce4 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:29.480617 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f74b4692-0bd0-4fb8-b4e6-f6c9163dcce4 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:29.519339 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d19ddf89-0fd3-4cce-9186-9dd21b90d344 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:29.519952 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d19ddf89-0fd3-4cce-9186-9dd21b90d344 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:29.526595 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d19ddf89-0fd3-4cce-9186-9dd21b90d344 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:29.527105 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d19ddf89-0fd3-4cce-9186-9dd21b90d344 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:29.527543 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d19ddf89-0fd3-4cce-9186-9dd21b90d344 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:29.528234 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d19ddf89-0fd3-4cce-9186-9dd21b90d344 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:29.528722 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d19ddf89-0fd3-4cce-9186-9dd21b90d344 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:29.529144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d19ddf89-0fd3-4cce-9186-9dd21b90d344 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:29.613158 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f74b4692-0bd0-4fb8-b4e6-f6c9163dcce4 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:29.620774 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f74b4692-0bd0-4fb8-b4e6-f6c9163dcce4 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 200 len: 1318 microversion: 2.1 time: 0.154924 Aug 30 05:15:29.625356 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 273/521] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:29 2022] GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:29.658002 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d19ddf89-0fd3-4cce-9186-9dd21b90d344 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:29.665969 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d19ddf89-0fd3-4cce-9186-9dd21b90d344 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1264 microversion: 2.1 time: 0.150356 Aug 30 05:15:29.666473 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 249/522] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:29 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:15:30.449199 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-62872923-6fe3-46cd-9500-4ddd8ecef21a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:30.449824 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-62872923-6fe3-46cd-9500-4ddd8ecef21a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:30.455734 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62872923-6fe3-46cd-9500-4ddd8ecef21a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:30.456216 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62872923-6fe3-46cd-9500-4ddd8ecef21a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:30.456646 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62872923-6fe3-46cd-9500-4ddd8ecef21a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:30.457327 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62872923-6fe3-46cd-9500-4ddd8ecef21a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:30.457772 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62872923-6fe3-46cd-9500-4ddd8ecef21a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:30.458194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-62872923-6fe3-46cd-9500-4ddd8ecef21a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:30.588421 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-62872923-6fe3-46cd-9500-4ddd8ecef21a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:30.597119 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-62872923-6fe3-46cd-9500-4ddd8ecef21a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:30.598542 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-62872923-6fe3-46cd-9500-4ddd8ecef21a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:30.600204 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-62872923-6fe3-46cd-9500-4ddd8ecef21a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.154951 Aug 30 05:15:30.600752 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 274/523] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:30 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:30.641267 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ad0b512a-73e6-4056-bcd8-4e062ee0047e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:30.641886 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ad0b512a-73e6-4056-bcd8-4e062ee0047e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:30.648300 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad0b512a-73e6-4056-bcd8-4e062ee0047e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:30.648783 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad0b512a-73e6-4056-bcd8-4e062ee0047e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:30.649223 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad0b512a-73e6-4056-bcd8-4e062ee0047e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:30.649916 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad0b512a-73e6-4056-bcd8-4e062ee0047e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:30.650371 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad0b512a-73e6-4056-bcd8-4e062ee0047e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:30.650797 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad0b512a-73e6-4056-bcd8-4e062ee0047e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:30.685701 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d740d9aa-3fb5-43a3-a8d7-356e0ec62a8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:30.686263 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d740d9aa-3fb5-43a3-a8d7-356e0ec62a8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:30.692261 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d740d9aa-3fb5-43a3-a8d7-356e0ec62a8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:30.692748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d740d9aa-3fb5-43a3-a8d7-356e0ec62a8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:30.693185 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d740d9aa-3fb5-43a3-a8d7-356e0ec62a8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:30.693887 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d740d9aa-3fb5-43a3-a8d7-356e0ec62a8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:30.694344 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d740d9aa-3fb5-43a3-a8d7-356e0ec62a8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:30.694770 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d740d9aa-3fb5-43a3-a8d7-356e0ec62a8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:30.782546 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ad0b512a-73e6-4056-bcd8-4e062ee0047e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:30.790714 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ad0b512a-73e6-4056-bcd8-4e062ee0047e tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 200 len: 1318 microversion: 2.1 time: 0.153190 Aug 30 05:15:30.791332 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 250/524] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:30 2022] GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:30.826375 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d740d9aa-3fb5-43a3-a8d7-356e0ec62a8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:30.834515 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d740d9aa-3fb5-43a3-a8d7-356e0ec62a8e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1264 microversion: 2.1 time: 0.152670 Aug 30 05:15:30.835112 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 275/525] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:30 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:15:31.103572 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-7aad45d9-4aeb-4d31-a09e-6b8542984029 req-b570f0b6-22ea-44c1-8f1d-77c42c1b9b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f83c589-3a23-45aa-96c5-3cf9006b3830", "name": "network-vif-plugged", "status": "completed", "tag": "c5da19b6-98a0-4af9-b8f5-52291d4a9be0"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:31.112963 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-7aad45d9-4aeb-4d31-a09e-6b8542984029 req-b570f0b6-22ea-44c1-8f1d-77c42c1b9b35 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:31.113454 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-7aad45d9-4aeb-4d31-a09e-6b8542984029 req-b570f0b6-22ea-44c1-8f1d-77c42c1b9b35 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:31.113885 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-7aad45d9-4aeb-4d31-a09e-6b8542984029 req-b570f0b6-22ea-44c1-8f1d-77c42c1b9b35 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:31.124700 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-7aad45d9-4aeb-4d31-a09e-6b8542984029 req-b570f0b6-22ea-44c1-8f1d-77c42c1b9b35 service nova] Creating event network-vif-plugged:c5da19b6-98a0-4af9-b8f5-52291d4a9be0 for instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 on hv-cinder-85391 Aug 30 05:15:31.130145 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-7aad45d9-4aeb-4d31-a09e-6b8542984029 req-b570f0b6-22ea-44c1-8f1d-77c42c1b9b35 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030045 Aug 30 05:15:31.131340 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 251/526] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:31.622898 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7ede9f1e-095e-49ed-bc6a-1399a72101f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:31.624421 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7ede9f1e-095e-49ed-bc6a-1399a72101f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:31.626413 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:31.633816 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ede9f1e-095e-49ed-bc6a-1399a72101f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:31.634325 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ede9f1e-095e-49ed-bc6a-1399a72101f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:31.635686 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ede9f1e-095e-49ed-bc6a-1399a72101f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:31.636407 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ede9f1e-095e-49ed-bc6a-1399a72101f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:31.637202 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ede9f1e-095e-49ed-bc6a-1399a72101f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:31.637652 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7ede9f1e-095e-49ed-bc6a-1399a72101f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:31.768197 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7ede9f1e-095e-49ed-bc6a-1399a72101f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:31.776804 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7ede9f1e-095e-49ed-bc6a-1399a72101f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:31.778242 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7ede9f1e-095e-49ed-bc6a-1399a72101f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:31.779431 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7ede9f1e-095e-49ed-bc6a-1399a72101f8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.160585 Aug 30 05:15:31.780000 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 276/527] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:31 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:31.808863 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=4 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:31.809623 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=12 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:31.814224 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0703c306-4aad-4165-8c76-036a877071c1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:31.814989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0703c306-4aad-4165-8c76-036a877071c1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:31.822472 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0703c306-4aad-4165-8c76-036a877071c1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:31.822996 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0703c306-4aad-4165-8c76-036a877071c1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:31.823434 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0703c306-4aad-4165-8c76-036a877071c1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:31.824119 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0703c306-4aad-4165-8c76-036a877071c1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:31.824593 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0703c306-4aad-4165-8c76-036a877071c1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:31.825003 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0703c306-4aad-4165-8c76-036a877071c1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:31.856325 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bc79f6f2-6681-425d-b758-e8c63976fad9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:31.857064 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bc79f6f2-6681-425d-b758-e8c63976fad9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:31.863113 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc79f6f2-6681-425d-b758-e8c63976fad9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:31.863604 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc79f6f2-6681-425d-b758-e8c63976fad9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:31.864034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc79f6f2-6681-425d-b758-e8c63976fad9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:31.864929 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc79f6f2-6681-425d-b758-e8c63976fad9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:31.865881 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc79f6f2-6681-425d-b758-e8c63976fad9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:31.866340 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc79f6f2-6681-425d-b758-e8c63976fad9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:31.965109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0703c306-4aad-4165-8c76-036a877071c1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:31.976361 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0703c306-4aad-4165-8c76-036a877071c1 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 200 len: 1506 microversion: 2.1 time: 0.168230 Aug 30 05:15:31.976859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 252/528] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:31 2022] GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:31.998967 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bc79f6f2-6681-425d-b758-e8c63976fad9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:32.004643 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eb9134ad-ea69-42a3-b38f-5e703a604c31 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1cfa388-617a-4ad3-b10d-2e24720e998c", "device": "/dev/sdb"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:32.007257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bc79f6f2-6681-425d-b758-e8c63976fad9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1264 microversion: 2.1 time: 0.154627 Aug 30 05:15:32.007394 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eb9134ad-ea69-42a3-b38f-5e703a604c31 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:32.008004 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 277/529] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:31 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:15:32.013281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb9134ad-ea69-42a3-b38f-5e703a604c31 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:32.013789 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb9134ad-ea69-42a3-b38f-5e703a604c31 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:32.014409 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb9134ad-ea69-42a3-b38f-5e703a604c31 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:32.015143 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb9134ad-ea69-42a3-b38f-5e703a604c31 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:32.015605 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb9134ad-ea69-42a3-b38f-5e703a604c31 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:32.016029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eb9134ad-ea69-42a3-b38f-5e703a604c31 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:32.800859 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e9d41487-cc1a-4b9a-bf54-f4e49452b5fa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:32.801474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e9d41487-cc1a-4b9a-bf54-f4e49452b5fa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:32.807951 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9d41487-cc1a-4b9a-bf54-f4e49452b5fa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:32.808434 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9d41487-cc1a-4b9a-bf54-f4e49452b5fa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:32.808870 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9d41487-cc1a-4b9a-bf54-f4e49452b5fa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:32.809562 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9d41487-cc1a-4b9a-bf54-f4e49452b5fa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:32.810018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9d41487-cc1a-4b9a-bf54-f4e49452b5fa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:32.810444 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e9d41487-cc1a-4b9a-bf54-f4e49452b5fa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:32.951963 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e9d41487-cc1a-4b9a-bf54-f4e49452b5fa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:32.962608 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e9d41487-cc1a-4b9a-bf54-f4e49452b5fa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:32.964475 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e9d41487-cc1a-4b9a-bf54-f4e49452b5fa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:32.965693 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e9d41487-cc1a-4b9a-bf54-f4e49452b5fa tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.168711 Aug 30 05:15:32.966633 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 278/530] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:32 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:15:33.028422 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-268cc4e5-e6e0-4d21-80be-b78d1dfeb4f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:33.030502 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-268cc4e5-e6e0-4d21-80be-b78d1dfeb4f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:33.038271 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-268cc4e5-e6e0-4d21-80be-b78d1dfeb4f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:33.038732 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-268cc4e5-e6e0-4d21-80be-b78d1dfeb4f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:33.039205 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-268cc4e5-e6e0-4d21-80be-b78d1dfeb4f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:33.039992 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-268cc4e5-e6e0-4d21-80be-b78d1dfeb4f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:33.040542 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-268cc4e5-e6e0-4d21-80be-b78d1dfeb4f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:33.041035 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-268cc4e5-e6e0-4d21-80be-b78d1dfeb4f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:33.045719 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eb9134ad-ea69-42a3-b38f-5e703a604c31 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "POST /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.052242 Aug 30 05:15:33.052118 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 253/531] 10.222.0.77 () {60 vars in 1323 bytes} [Tue Aug 30 05:15:31 2022] POST /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576/os-volume_attachments => generated 194 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:15:33.188263 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-268cc4e5-e6e0-4d21-80be-b78d1dfeb4f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:33.196835 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-268cc4e5-e6e0-4d21-80be-b78d1dfeb4f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1264 microversion: 2.1 time: 0.173072 Aug 30 05:15:33.197401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 279/532] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:33 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:15:33.989058 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-37083b2f-057e-4544-9e9c-d408892e45e5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:33.989715 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-37083b2f-057e-4544-9e9c-d408892e45e5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:33.996042 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37083b2f-057e-4544-9e9c-d408892e45e5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:33.996631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37083b2f-057e-4544-9e9c-d408892e45e5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:33.996974 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37083b2f-057e-4544-9e9c-d408892e45e5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:33.997666 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37083b2f-057e-4544-9e9c-d408892e45e5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:33.998118 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37083b2f-057e-4544-9e9c-d408892e45e5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:33.998542 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-37083b2f-057e-4544-9e9c-d408892e45e5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:34.002587 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:34.131799 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-37083b2f-057e-4544-9e9c-d408892e45e5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:34.140622 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-37083b2f-057e-4544-9e9c-d408892e45e5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:34.142068 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-37083b2f-057e-4544-9e9c-d408892e45e5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:34.143263 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-37083b2f-057e-4544-9e9c-d408892e45e5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.159052 Aug 30 05:15:34.143825 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 254/533] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:33 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:15:34.216560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dc9070c8-7d06-4504-a3f2-d67cefa5aa6e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:34.217176 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dc9070c8-7d06-4504-a3f2-d67cefa5aa6e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:34.223766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc9070c8-7d06-4504-a3f2-d67cefa5aa6e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:34.224277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc9070c8-7d06-4504-a3f2-d67cefa5aa6e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:34.224710 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc9070c8-7d06-4504-a3f2-d67cefa5aa6e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:34.225393 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc9070c8-7d06-4504-a3f2-d67cefa5aa6e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:34.225846 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc9070c8-7d06-4504-a3f2-d67cefa5aa6e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:34.226267 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dc9070c8-7d06-4504-a3f2-d67cefa5aa6e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:34.356870 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-dc9070c8-7d06-4504-a3f2-d67cefa5aa6e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:34.364547 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dc9070c8-7d06-4504-a3f2-d67cefa5aa6e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1264 microversion: 2.1 time: 0.151824 Aug 30 05:15:34.365147 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 280/534] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:34 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:35.043449 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-259010ce-2f33-41df-9c2c-f82d43526d8d req-2d10cc17-1fd9-4538-aeea-1226b663f16a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6", "name": "network-vif-plugged", "status": "completed", "tag": "f08307cf-f44e-403c-bd63-0b7921eca530"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:35.056820 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-259010ce-2f33-41df-9c2c-f82d43526d8d req-2d10cc17-1fd9-4538-aeea-1226b663f16a service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:35.057517 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-259010ce-2f33-41df-9c2c-f82d43526d8d req-2d10cc17-1fd9-4538-aeea-1226b663f16a service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:35.058096 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-259010ce-2f33-41df-9c2c-f82d43526d8d req-2d10cc17-1fd9-4538-aeea-1226b663f16a service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:35.069459 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-259010ce-2f33-41df-9c2c-f82d43526d8d req-2d10cc17-1fd9-4538-aeea-1226b663f16a service nova] Creating event network-vif-plugged:f08307cf-f44e-403c-bd63-0b7921eca530 for instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 on hv-cinder-85391 Aug 30 05:15:35.074628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-259010ce-2f33-41df-9c2c-f82d43526d8d req-2d10cc17-1fd9-4538-aeea-1226b663f16a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034825 Aug 30 05:15:35.075710 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 255/535] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:35.167315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b0694fe5-c11b-4b77-8c38-2c048e8af429 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:35.167866 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b0694fe5-c11b-4b77-8c38-2c048e8af429 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:35.173924 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0694fe5-c11b-4b77-8c38-2c048e8af429 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:35.174405 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0694fe5-c11b-4b77-8c38-2c048e8af429 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:35.174896 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0694fe5-c11b-4b77-8c38-2c048e8af429 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:35.175544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0694fe5-c11b-4b77-8c38-2c048e8af429 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:35.176017 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0694fe5-c11b-4b77-8c38-2c048e8af429 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:35.176464 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0694fe5-c11b-4b77-8c38-2c048e8af429 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:35.307900 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b0694fe5-c11b-4b77-8c38-2c048e8af429 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:35.317504 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b0694fe5-c11b-4b77-8c38-2c048e8af429 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:35.319075 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b0694fe5-c11b-4b77-8c38-2c048e8af429 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:35.320447 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b0694fe5-c11b-4b77-8c38-2c048e8af429 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1808 microversion: 2.20 time: 0.157732 Aug 30 05:15:35.321077 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 281/536] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:35 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:35.385397 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5f3dc873-e508-4b21-a3ce-9a07ca89eee8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:35.386105 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5f3dc873-e508-4b21-a3ce-9a07ca89eee8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:35.392628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f3dc873-e508-4b21-a3ce-9a07ca89eee8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:35.393108 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f3dc873-e508-4b21-a3ce-9a07ca89eee8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:35.393550 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f3dc873-e508-4b21-a3ce-9a07ca89eee8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:35.394259 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f3dc873-e508-4b21-a3ce-9a07ca89eee8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:35.394724 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f3dc873-e508-4b21-a3ce-9a07ca89eee8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:35.395188 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5f3dc873-e508-4b21-a3ce-9a07ca89eee8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:35.530234 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5f3dc873-e508-4b21-a3ce-9a07ca89eee8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:35.537795 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5f3dc873-e508-4b21-a3ce-9a07ca89eee8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1264 microversion: 2.1 time: 0.156619 Aug 30 05:15:35.538360 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 256/537] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:35 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:35.955695 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6687e413-d4c0-4e5d-882e-6593db832cf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:35.956486 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6687e413-d4c0-4e5d-882e-6593db832cf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:35.962711 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6687e413-d4c0-4e5d-882e-6593db832cf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:35.963235 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6687e413-d4c0-4e5d-882e-6593db832cf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:35.963666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6687e413-d4c0-4e5d-882e-6593db832cf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:35.964340 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6687e413-d4c0-4e5d-882e-6593db832cf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:35.964783 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6687e413-d4c0-4e5d-882e-6593db832cf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:35.965201 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6687e413-d4c0-4e5d-882e-6593db832cf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:36.087707 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-6687e413-d4c0-4e5d-882e-6593db832cf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lazy-loading 'services' on Instance uuid 2a54dc6f-8cee-4b66-9486-491841d01c27 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:15:36.198458 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6687e413-d4c0-4e5d-882e-6593db832cf5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/os-volume_attachments/dd53c05e-4b78-4b9c-982c-5989bede3106" status: 202 len: 0 microversion: 2.1 time: 0.246441 Aug 30 05:15:36.199069 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 282/538] 10.222.0.77 () {58 vars in 1416 bytes} [Tue Aug 30 05:15:35 2022] DELETE /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/os-volume_attachments/dd53c05e-4b78-4b9c-982c-5989bede3106 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:15:36.342883 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e1fa2a7e-f94b-4f3a-a715-bd433a88cc13 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:36.343531 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e1fa2a7e-f94b-4f3a-a715-bd433a88cc13 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:36.350136 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1fa2a7e-f94b-4f3a-a715-bd433a88cc13 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:36.351136 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1fa2a7e-f94b-4f3a-a715-bd433a88cc13 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:36.351582 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1fa2a7e-f94b-4f3a-a715-bd433a88cc13 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:36.352283 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1fa2a7e-f94b-4f3a-a715-bd433a88cc13 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:36.352806 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1fa2a7e-f94b-4f3a-a715-bd433a88cc13 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:36.353356 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e1fa2a7e-f94b-4f3a-a715-bd433a88cc13 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:36.480358 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e1fa2a7e-f94b-4f3a-a715-bd433a88cc13 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:36.488999 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e1fa2a7e-f94b-4f3a-a715-bd433a88cc13 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:36.490450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e1fa2a7e-f94b-4f3a-a715-bd433a88cc13 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:36.491816 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e1fa2a7e-f94b-4f3a-a715-bd433a88cc13 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1795 microversion: 2.20 time: 0.153110 Aug 30 05:15:36.492890 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 257/539] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:15:36 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1795 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:15:36.558614 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7c171f73-5803-4186-8859-dacc49746d15 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:36.559367 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7c171f73-5803-4186-8859-dacc49746d15 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:36.565828 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c171f73-5803-4186-8859-dacc49746d15 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:36.566309 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c171f73-5803-4186-8859-dacc49746d15 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:36.566744 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c171f73-5803-4186-8859-dacc49746d15 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:36.567454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c171f73-5803-4186-8859-dacc49746d15 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:36.568182 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c171f73-5803-4186-8859-dacc49746d15 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:36.568609 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c171f73-5803-4186-8859-dacc49746d15 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:36.572542 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:36.704889 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7c171f73-5803-4186-8859-dacc49746d15 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:36.712886 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7c171f73-5803-4186-8859-dacc49746d15 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1264 microversion: 2.1 time: 0.159101 Aug 30 05:15:36.713444 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 283/540] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:36 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:37.734092 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-464f43f3-de49-4ceb-b664-60c26f51445b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:37.734618 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-464f43f3-de49-4ceb-b664-60c26f51445b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:37.740993 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-464f43f3-de49-4ceb-b664-60c26f51445b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:37.741973 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-464f43f3-de49-4ceb-b664-60c26f51445b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:37.742407 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-464f43f3-de49-4ceb-b664-60c26f51445b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:37.743124 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-464f43f3-de49-4ceb-b664-60c26f51445b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:37.743582 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-464f43f3-de49-4ceb-b664-60c26f51445b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:37.744004 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-464f43f3-de49-4ceb-b664-60c26f51445b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:37.873621 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-464f43f3-de49-4ceb-b664-60c26f51445b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:37.881229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-464f43f3-de49-4ceb-b664-60c26f51445b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1451 microversion: 2.1 time: 0.151075 Aug 30 05:15:37.881799 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 258/541] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:37 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:37.900977 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8af3f777-d23e-4dc8-8959-73107f754abe tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:37.901675 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8af3f777-d23e-4dc8-8959-73107f754abe tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:37.908080 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8af3f777-d23e-4dc8-8959-73107f754abe tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:37.908577 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8af3f777-d23e-4dc8-8959-73107f754abe tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:37.909277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8af3f777-d23e-4dc8-8959-73107f754abe tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:37.909971 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8af3f777-d23e-4dc8-8959-73107f754abe tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:37.910419 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8af3f777-d23e-4dc8-8959-73107f754abe tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:37.910877 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8af3f777-d23e-4dc8-8959-73107f754abe tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:38.038982 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-8af3f777-d23e-4dc8-8959-73107f754abe tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:38.046654 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8af3f777-d23e-4dc8-8959-73107f754abe tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1451 microversion: 2.1 time: 0.149751 Aug 30 05:15:38.047242 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 284/542] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:37 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:39.854292 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-84515c02-8450-4d5a-9f81-be54b2999a47 req-a2a01089-d2e4-44d4-8ea8-0b3be6aa25ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6", "tag": "f08307cf-f44e-403c-bd63-0b7921eca530"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:39.864285 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-84515c02-8450-4d5a-9f81-be54b2999a47 req-a2a01089-d2e4-44d4-8ea8-0b3be6aa25ad service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:39.864757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-84515c02-8450-4d5a-9f81-be54b2999a47 req-a2a01089-d2e4-44d4-8ea8-0b3be6aa25ad service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:39.865217 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-84515c02-8450-4d5a-9f81-be54b2999a47 req-a2a01089-d2e4-44d4-8ea8-0b3be6aa25ad service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:39.876026 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-84515c02-8450-4d5a-9f81-be54b2999a47 req-a2a01089-d2e4-44d4-8ea8-0b3be6aa25ad service nova] Creating event network-changed:f08307cf-f44e-403c-bd63-0b7921eca530 for instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 on hv-cinder-85391 Aug 30 05:15:39.881069 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-84515c02-8450-4d5a-9f81-be54b2999a47 req-a2a01089-d2e4-44d4-8ea8-0b3be6aa25ad service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030988 Aug 30 05:15:39.881671 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 259/543] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:42.602214 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7b9fccf9-ada1-4ff9-a7dd-8d57dc721d3d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:42.608804 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b9fccf9-ada1-4ff9-a7dd-8d57dc721d3d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:42.609286 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b9fccf9-ada1-4ff9-a7dd-8d57dc721d3d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:42.609725 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7b9fccf9-ada1-4ff9-a7dd-8d57dc721d3d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:42.632268 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7b9fccf9-ada1-4ff9-a7dd-8d57dc721d3d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Going to try to stop instance {{(pid=120572) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 05:15:42.672619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7b9fccf9-ada1-4ff9-a7dd-8d57dc721d3d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "POST /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/action" status: 202 len: 0 microversion: 2.1 time: 0.074654 Aug 30 05:15:42.673227 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 285/544] 10.222.0.77 () {60 vars in 1278 bytes} [Tue Aug 30 05:15:42 2022] POST /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:15:42.682596 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6756b2d0-11a8-4338-afbb-60596f6d48b7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:42.683394 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6756b2d0-11a8-4338-afbb-60596f6d48b7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:42.689531 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6756b2d0-11a8-4338-afbb-60596f6d48b7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:42.689944 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6756b2d0-11a8-4338-afbb-60596f6d48b7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:42.690378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6756b2d0-11a8-4338-afbb-60596f6d48b7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:42.691096 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6756b2d0-11a8-4338-afbb-60596f6d48b7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:42.691553 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6756b2d0-11a8-4338-afbb-60596f6d48b7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:42.691976 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6756b2d0-11a8-4338-afbb-60596f6d48b7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:42.819371 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6756b2d0-11a8-4338-afbb-60596f6d48b7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:42.826973 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6756b2d0-11a8-4338-afbb-60596f6d48b7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1676 microversion: 2.1 time: 0.149170 Aug 30 05:15:42.827544 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 260/545] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:42 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:43.849261 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a269643f-57cd-4230-bdde-d32196dc230c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:43.849955 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a269643f-57cd-4230-bdde-d32196dc230c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:43.856464 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a269643f-57cd-4230-bdde-d32196dc230c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:43.856945 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a269643f-57cd-4230-bdde-d32196dc230c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:43.857381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a269643f-57cd-4230-bdde-d32196dc230c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:43.858063 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a269643f-57cd-4230-bdde-d32196dc230c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:43.858513 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a269643f-57cd-4230-bdde-d32196dc230c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:43.858962 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a269643f-57cd-4230-bdde-d32196dc230c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:43.988260 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a269643f-57cd-4230-bdde-d32196dc230c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:43.996717 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a269643f-57cd-4230-bdde-d32196dc230c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1676 microversion: 2.1 time: 0.152061 Aug 30 05:15:43.997286 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 286/546] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:43 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:45.017785 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f6341015-7bfb-459a-8a42-6ef130589e0f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:45.018305 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f6341015-7bfb-459a-8a42-6ef130589e0f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:45.024941 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6341015-7bfb-459a-8a42-6ef130589e0f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:45.025432 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6341015-7bfb-459a-8a42-6ef130589e0f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:45.025870 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6341015-7bfb-459a-8a42-6ef130589e0f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:45.026559 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6341015-7bfb-459a-8a42-6ef130589e0f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:45.027057 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6341015-7bfb-459a-8a42-6ef130589e0f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:45.027483 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6341015-7bfb-459a-8a42-6ef130589e0f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:45.152181 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f6341015-7bfb-459a-8a42-6ef130589e0f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:45.159769 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f6341015-7bfb-459a-8a42-6ef130589e0f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1676 microversion: 2.1 time: 0.145922 Aug 30 05:15:45.160331 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 261/547] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:45 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:46.180082 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-33e0b35c-acf5-4012-9cf0-aedb5b038804 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:46.180618 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-33e0b35c-acf5-4012-9cf0-aedb5b038804 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:46.187182 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33e0b35c-acf5-4012-9cf0-aedb5b038804 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:46.187662 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33e0b35c-acf5-4012-9cf0-aedb5b038804 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:46.188096 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33e0b35c-acf5-4012-9cf0-aedb5b038804 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:46.188779 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33e0b35c-acf5-4012-9cf0-aedb5b038804 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:46.189234 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33e0b35c-acf5-4012-9cf0-aedb5b038804 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:46.189662 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-33e0b35c-acf5-4012-9cf0-aedb5b038804 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:46.314435 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-33e0b35c-acf5-4012-9cf0-aedb5b038804 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:46.322559 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-33e0b35c-acf5-4012-9cf0-aedb5b038804 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1676 microversion: 2.1 time: 0.146436 Aug 30 05:15:46.323149 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 287/548] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:46 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1676 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:47.344088 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f5fac913-7c04-408a-98c7-2c212830a37d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:47.344640 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f5fac913-7c04-408a-98c7-2c212830a37d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:47.351649 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5fac913-7c04-408a-98c7-2c212830a37d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:47.352130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5fac913-7c04-408a-98c7-2c212830a37d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:47.352567 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5fac913-7c04-408a-98c7-2c212830a37d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:47.353254 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5fac913-7c04-408a-98c7-2c212830a37d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:47.353710 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5fac913-7c04-408a-98c7-2c212830a37d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:47.354132 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5fac913-7c04-408a-98c7-2c212830a37d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:47.483201 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f5fac913-7c04-408a-98c7-2c212830a37d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:47.490894 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f5fac913-7c04-408a-98c7-2c212830a37d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1676 microversion: 2.1 time: 0.150894 Aug 30 05:15:47.491499 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 262/549] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:47 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:48.511591 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-891fbadb-5a5e-453d-ad6f-f4505d428598 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:48.512202 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-891fbadb-5a5e-453d-ad6f-f4505d428598 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:48.514624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=72 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:48.519925 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-891fbadb-5a5e-453d-ad6f-f4505d428598 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:48.520406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-891fbadb-5a5e-453d-ad6f-f4505d428598 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:48.520841 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-891fbadb-5a5e-453d-ad6f-f4505d428598 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:48.521533 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-891fbadb-5a5e-453d-ad6f-f4505d428598 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:48.521984 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-891fbadb-5a5e-453d-ad6f-f4505d428598 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:48.522423 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-891fbadb-5a5e-453d-ad6f-f4505d428598 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:48.650266 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-891fbadb-5a5e-453d-ad6f-f4505d428598 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:48.657835 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-891fbadb-5a5e-453d-ad6f-f4505d428598 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1676 microversion: 2.1 time: 0.150084 Aug 30 05:15:48.658403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 288/550] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:48 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:49.680096 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f483aefa-7015-488d-aabb-7122698b7653 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:49.680745 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f483aefa-7015-488d-aabb-7122698b7653 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:49.687085 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f483aefa-7015-488d-aabb-7122698b7653 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:49.687577 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f483aefa-7015-488d-aabb-7122698b7653 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:49.688020 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f483aefa-7015-488d-aabb-7122698b7653 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:49.688720 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f483aefa-7015-488d-aabb-7122698b7653 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:49.689184 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f483aefa-7015-488d-aabb-7122698b7653 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:49.689613 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f483aefa-7015-488d-aabb-7122698b7653 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:49.816391 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f483aefa-7015-488d-aabb-7122698b7653 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:49.824053 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f483aefa-7015-488d-aabb-7122698b7653 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1676 microversion: 2.1 time: 0.148383 Aug 30 05:15:49.824625 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 263/551] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:49 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:50.845301 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c5073315-2c2c-4f29-ae4f-537eab1f52ec tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:50.845911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c5073315-2c2c-4f29-ae4f-537eab1f52ec tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:50.852301 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c5073315-2c2c-4f29-ae4f-537eab1f52ec tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:50.852772 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c5073315-2c2c-4f29-ae4f-537eab1f52ec tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:50.853201 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c5073315-2c2c-4f29-ae4f-537eab1f52ec tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:50.853880 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c5073315-2c2c-4f29-ae4f-537eab1f52ec tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:50.854324 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c5073315-2c2c-4f29-ae4f-537eab1f52ec tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:50.854744 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c5073315-2c2c-4f29-ae4f-537eab1f52ec tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:50.987081 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c5073315-2c2c-4f29-ae4f-537eab1f52ec tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:50.994572 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c5073315-2c2c-4f29-ae4f-537eab1f52ec tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1676 microversion: 2.1 time: 0.153474 Aug 30 05:15:50.995163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 289/552] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:50 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:52.017607 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fba3c1f4-163f-4222-b358-2b1e5e402f0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:52.018249 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fba3c1f4-163f-4222-b358-2b1e5e402f0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:52.025689 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fba3c1f4-163f-4222-b358-2b1e5e402f0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:52.026172 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fba3c1f4-163f-4222-b358-2b1e5e402f0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:52.026604 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fba3c1f4-163f-4222-b358-2b1e5e402f0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:52.027319 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fba3c1f4-163f-4222-b358-2b1e5e402f0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:52.027771 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fba3c1f4-163f-4222-b358-2b1e5e402f0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:52.028191 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fba3c1f4-163f-4222-b358-2b1e5e402f0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:52.407376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fba3c1f4-163f-4222-b358-2b1e5e402f0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:52.418272 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fba3c1f4-163f-4222-b358-2b1e5e402f0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1676 microversion: 2.1 time: 0.404449 Aug 30 05:15:52.428704 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 264/553] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:52 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1676 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:53.439323 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e0745939-e676-44b6-bcb4-e72456874a7f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:53.439857 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e0745939-e676-44b6-bcb4-e72456874a7f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:53.446195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0745939-e676-44b6-bcb4-e72456874a7f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:53.447006 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0745939-e676-44b6-bcb4-e72456874a7f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:53.447140 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0745939-e676-44b6-bcb4-e72456874a7f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:53.447777 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0745939-e676-44b6-bcb4-e72456874a7f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:53.448223 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0745939-e676-44b6-bcb4-e72456874a7f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:53.448639 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e0745939-e676-44b6-bcb4-e72456874a7f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:53.470403 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0312b284-164f-490d-9f66-ee2023590a5b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:53.470937 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0312b284-164f-490d-9f66-ee2023590a5b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:53.473412 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=51 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:53.479380 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0312b284-164f-490d-9f66-ee2023590a5b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:53.479888 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0312b284-164f-490d-9f66-ee2023590a5b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:53.480333 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0312b284-164f-490d-9f66-ee2023590a5b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:53.481013 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0312b284-164f-490d-9f66-ee2023590a5b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:53.481503 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0312b284-164f-490d-9f66-ee2023590a5b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:53.481930 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0312b284-164f-490d-9f66-ee2023590a5b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:53.562533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-0312b284-164f-490d-9f66-ee2023590a5b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lazy-loading 'services' on Instance uuid 1f137b0e-9fb0-41ce-8bfa-a42616c11576 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:15:53.581263 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e0745939-e676-44b6-bcb4-e72456874a7f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:53.589625 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e0745939-e676-44b6-bcb4-e72456874a7f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1676 microversion: 2.1 time: 0.154107 Aug 30 05:15:53.590119 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 290/554] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:53 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:53.638369 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0312b284-164f-490d-9f66-ee2023590a5b tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "DELETE /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576/os-volume_attachments/f1cfa388-617a-4ad3-b10d-2e24720e998c" status: 202 len: 0 microversion: 2.1 time: 0.172266 Aug 30 05:15:53.638996 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 265/555] 10.222.0.77 () {58 vars in 1416 bytes} [Tue Aug 30 05:15:53 2022] DELETE /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576/os-volume_attachments/f1cfa388-617a-4ad3-b10d-2e24720e998c => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 05:15:54.610440 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f0454789-1a54-4f0a-b1bf-9662759e17fd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:54.611044 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f0454789-1a54-4f0a-b1bf-9662759e17fd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:54.617996 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f0454789-1a54-4f0a-b1bf-9662759e17fd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:54.618499 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f0454789-1a54-4f0a-b1bf-9662759e17fd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:54.618967 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f0454789-1a54-4f0a-b1bf-9662759e17fd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:54.619654 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f0454789-1a54-4f0a-b1bf-9662759e17fd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:54.620106 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f0454789-1a54-4f0a-b1bf-9662759e17fd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:54.620525 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f0454789-1a54-4f0a-b1bf-9662759e17fd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:54.751964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f0454789-1a54-4f0a-b1bf-9662759e17fd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:54.760135 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f0454789-1a54-4f0a-b1bf-9662759e17fd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1676 microversion: 2.1 time: 0.153586 Aug 30 05:15:54.760687 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 291/556] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:54 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:54.765139 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1a370190-121b-4cb6-b13f-3aa86abe95c0 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:54.765725 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1a370190-121b-4cb6-b13f-3aa86abe95c0 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:54.771892 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a370190-121b-4cb6-b13f-3aa86abe95c0 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:54.772382 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a370190-121b-4cb6-b13f-3aa86abe95c0 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:54.772819 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a370190-121b-4cb6-b13f-3aa86abe95c0 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:54.774018 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a370190-121b-4cb6-b13f-3aa86abe95c0 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:54.774474 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a370190-121b-4cb6-b13f-3aa86abe95c0 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:54.774931 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a370190-121b-4cb6-b13f-3aa86abe95c0 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:54.799795 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1a370190-121b-4cb6-b13f-3aa86abe95c0 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:15:54.871788 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1a370190-121b-4cb6-b13f-3aa86abe95c0 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "DELETE /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 204 len: 0 microversion: 2.1 time: 0.111082 Aug 30 05:15:54.872504 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 266/557] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:15:54 2022] DELETE /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 05:15:54.880462 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4a42c009-f8d6-4e29-80c9-618cba4ae272 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:54.881123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4a42c009-f8d6-4e29-80c9-618cba4ae272 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:54.887484 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a42c009-f8d6-4e29-80c9-618cba4ae272 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:54.887969 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a42c009-f8d6-4e29-80c9-618cba4ae272 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:54.888404 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a42c009-f8d6-4e29-80c9-618cba4ae272 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:54.889093 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a42c009-f8d6-4e29-80c9-618cba4ae272 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:54.889548 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a42c009-f8d6-4e29-80c9-618cba4ae272 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:54.889976 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a42c009-f8d6-4e29-80c9-618cba4ae272 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:55.017820 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4a42c009-f8d6-4e29-80c9-618cba4ae272 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:55.026131 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4a42c009-f8d6-4e29-80c9-618cba4ae272 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 200 len: 1512 microversion: 2.1 time: 0.149522 Aug 30 05:15:55.026698 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 292/558] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:54 2022] GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:55.782929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4b68d70e-72a9-4c05-b396-5ec307e9f231 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:55.783585 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4b68d70e-72a9-4c05-b396-5ec307e9f231 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:55.790308 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b68d70e-72a9-4c05-b396-5ec307e9f231 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:55.790788 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b68d70e-72a9-4c05-b396-5ec307e9f231 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:55.791243 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b68d70e-72a9-4c05-b396-5ec307e9f231 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:55.791922 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b68d70e-72a9-4c05-b396-5ec307e9f231 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:55.792400 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b68d70e-72a9-4c05-b396-5ec307e9f231 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:55.792824 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b68d70e-72a9-4c05-b396-5ec307e9f231 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:55.916780 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4b68d70e-72a9-4c05-b396-5ec307e9f231 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:55.924333 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4b68d70e-72a9-4c05-b396-5ec307e9f231 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1676 microversion: 2.1 time: 0.145715 Aug 30 05:15:55.924894 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 267/559] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:55 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:56.046014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bbccacb1-c574-4e10-8e5b-d6710e900ea3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:56.046621 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bbccacb1-c574-4e10-8e5b-d6710e900ea3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:56.052949 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbccacb1-c574-4e10-8e5b-d6710e900ea3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:56.053421 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbccacb1-c574-4e10-8e5b-d6710e900ea3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:56.053856 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbccacb1-c574-4e10-8e5b-d6710e900ea3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:56.055205 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbccacb1-c574-4e10-8e5b-d6710e900ea3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:56.055660 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbccacb1-c574-4e10-8e5b-d6710e900ea3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:56.056079 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbccacb1-c574-4e10-8e5b-d6710e900ea3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:56.185122 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bbccacb1-c574-4e10-8e5b-d6710e900ea3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:56.192768 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bbccacb1-c574-4e10-8e5b-d6710e900ea3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 200 len: 1512 microversion: 2.1 time: 0.150571 Aug 30 05:15:56.193331 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 293/560] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:56 2022] GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:56.946063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f88a7442-9f5b-49a9-8b47-40f2cb5938ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:56.946675 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f88a7442-9f5b-49a9-8b47-40f2cb5938ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:56.952958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f88a7442-9f5b-49a9-8b47-40f2cb5938ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:56.953441 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f88a7442-9f5b-49a9-8b47-40f2cb5938ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:56.953872 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f88a7442-9f5b-49a9-8b47-40f2cb5938ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:56.954557 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f88a7442-9f5b-49a9-8b47-40f2cb5938ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:56.955042 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f88a7442-9f5b-49a9-8b47-40f2cb5938ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:56.955460 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f88a7442-9f5b-49a9-8b47-40f2cb5938ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:57.159604 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f88a7442-9f5b-49a9-8b47-40f2cb5938ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:57.167246 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f88a7442-9f5b-49a9-8b47-40f2cb5938ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1653 microversion: 2.1 time: 0.225635 Aug 30 05:15:57.167822 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 268/561] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:56 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1653 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:57.187737 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cc389156-418e-40f3-9201-e8de6ef88ecf tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:57.194137 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc389156-418e-40f3-9201-e8de6ef88ecf tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:57.194622 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc389156-418e-40f3-9201-e8de6ef88ecf tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:57.195105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cc389156-418e-40f3-9201-e8de6ef88ecf tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:57.213404 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6db0da06-becb-43a2-9e83-0504e93b51f3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:57.214126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6db0da06-becb-43a2-9e83-0504e93b51f3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:57.218117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cc389156-418e-40f3-9201-e8de6ef88ecf tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Going to try to start instance {{(pid=120572) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 05:15:57.220364 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6db0da06-becb-43a2-9e83-0504e93b51f3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:57.220913 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6db0da06-becb-43a2-9e83-0504e93b51f3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:57.221705 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6db0da06-becb-43a2-9e83-0504e93b51f3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:57.222618 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6db0da06-becb-43a2-9e83-0504e93b51f3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:57.223166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6db0da06-becb-43a2-9e83-0504e93b51f3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:57.223592 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6db0da06-becb-43a2-9e83-0504e93b51f3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:57.264002 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cc389156-418e-40f3-9201-e8de6ef88ecf tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "POST /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/action" status: 202 len: 0 microversion: 2.1 time: 0.079507 Aug 30 05:15:57.264816 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 294/562] 10.222.0.77 () {60 vars in 1278 bytes} [Tue Aug 30 05:15:57 2022] POST /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:15:57.276275 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3b071528-8867-490a-92ee-506b0346542d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:57.276965 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3b071528-8867-490a-92ee-506b0346542d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:57.283451 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b071528-8867-490a-92ee-506b0346542d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:57.284256 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b071528-8867-490a-92ee-506b0346542d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:57.284763 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b071528-8867-490a-92ee-506b0346542d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:57.285554 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b071528-8867-490a-92ee-506b0346542d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:57.286021 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b071528-8867-490a-92ee-506b0346542d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:57.286433 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b071528-8867-490a-92ee-506b0346542d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:57.451182 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3b071528-8867-490a-92ee-506b0346542d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:57.462481 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3b071528-8867-490a-92ee-506b0346542d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1662 microversion: 2.1 time: 0.190453 Aug 30 05:15:57.463320 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 295/563] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:57 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1662 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:15:57.515294 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6db0da06-becb-43a2-9e83-0504e93b51f3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7522bcceac404e8aa10f719507fe1436', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd98f56be5fb14ebe9e938ebc0f642994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:57.518735 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:57.530608 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6db0da06-becb-43a2-9e83-0504e93b51f3 tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 200 len: 1512 microversion: 2.1 time: 0.321000 Aug 30 05:15:57.533234 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 269/564] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:57 2022] GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 1512 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:15:57.533381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-6575b74d-2822-4f99-996f-e94fb34bfa94 req-86f16d5a-0a20-4131-a8d2-70ef80bb5e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f137b0e-9fb0-41ce-8bfa-a42616c11576", "name": "network-vif-deleted", "tag": "2315c25e-223b-4438-add1-64c8835a4abc"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:57.547129 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-6575b74d-2822-4f99-996f-e94fb34bfa94 req-86f16d5a-0a20-4131-a8d2-70ef80bb5e22 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:57.547902 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-6575b74d-2822-4f99-996f-e94fb34bfa94 req-86f16d5a-0a20-4131-a8d2-70ef80bb5e22 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:57.548459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-6575b74d-2822-4f99-996f-e94fb34bfa94 req-86f16d5a-0a20-4131-a8d2-70ef80bb5e22 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:57.562969 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-6575b74d-2822-4f99-996f-e94fb34bfa94 req-86f16d5a-0a20-4131-a8d2-70ef80bb5e22 service nova] Creating event network-vif-deleted:2315c25e-223b-4438-add1-64c8835a4abc for instance 1f137b0e-9fb0-41ce-8bfa-a42616c11576 on hv-cinder-85391 Aug 30 05:15:57.568237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-6575b74d-2822-4f99-996f-e94fb34bfa94 req-86f16d5a-0a20-4131-a8d2-70ef80bb5e22 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040122 Aug 30 05:15:57.569147 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 296/565] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:58.484596 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-012c8e79-8b71-456a-94f3-c2eb45ca2882 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:58.485295 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-012c8e79-8b71-456a-94f3-c2eb45ca2882 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:58.492632 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-012c8e79-8b71-456a-94f3-c2eb45ca2882 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:58.493193 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-012c8e79-8b71-456a-94f3-c2eb45ca2882 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:58.493627 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-012c8e79-8b71-456a-94f3-c2eb45ca2882 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:58.494545 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-012c8e79-8b71-456a-94f3-c2eb45ca2882 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:58.495023 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-012c8e79-8b71-456a-94f3-c2eb45ca2882 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:58.495456 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-012c8e79-8b71-456a-94f3-c2eb45ca2882 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:58.555133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4a31bd24-858a-42a1-862c-44bd2e75daac tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:58.556119 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4a31bd24-858a-42a1-862c-44bd2e75daac tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] [instance: 1f137b0e-9fb0-41ce-8bfa-a42616c11576] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:58.564294 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a31bd24-858a-42a1-862c-44bd2e75daac tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:58.565088 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a31bd24-858a-42a1-862c-44bd2e75daac tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:58.565799 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a31bd24-858a-42a1-862c-44bd2e75daac tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:58.566564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a31bd24-858a-42a1-862c-44bd2e75daac tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:58.567360 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a31bd24-858a-42a1-862c-44bd2e75daac tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:58.567857 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a31bd24-858a-42a1-862c-44bd2e75daac tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:58.582681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-4a31bd24-858a-42a1-862c-44bd2e75daac tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] HTTP exception thrown: Instance 1f137b0e-9fb0-41ce-8bfa-a42616c11576 could not be found. Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4a31bd24-858a-42a1-862c-44bd2e75daac tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Request method failure captured: Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 HTTP/1.1 Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZyKskjo2eDxOI5o0ltLNJGbqKI4ItjIeggZtsHnc0S6jFeBCfmc0dmrxgByUhOA5KHYkmW8HCiXMGooxpLr7b5c0Ym83oKFdkRq8skfWOgRVIXePAklyAA_X7kkrfqzCItcG8Ep9yUF-qJirs9dP2en1Xv70xg_3giM3A7_wSm-9j4 Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: d98f56be5fb14ebe9e938ebc0f642994 Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesSnapshotTestJSON-874921642 Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:15:58.584454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:15:58.586127 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/d98f56be5fb14ebe9e938ebc0f642994"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/d98f56be5fb14ebe9e938ebc0f642994"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/d98f56be5fb14ebe9e938ebc0f642994"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_d98f56be5fb14ebe9e938ebc0f642994", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:15:58.586127 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesSnapshotTestJSON-874921642 Aug 30 05:15:58.586127 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: d98f56be5fb14ebe9e938ebc0f642994 Aug 30 05:15:58.586127 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-874921642 Aug 30 05:15:58.586127 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesSnapshotTestJSON-874921642-project Aug 30 05:15:58.586127 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:15:58.586127 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:15:58.586127 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: 7522bcceac404e8aa10f719507fe1436 Aug 30 05:15:58.586127 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesSnapshotTestJSON-874921642-project Aug 30 05:15:58.586127 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:15:58.586127 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 1f137b0e-9fb0-41ce-8bfa-a42616c11576 could not be found. Aug 30 05:15:58.586127 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '1f137b0e-9fb0-41ce-8bfa-a42616c11576'} Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f137b0e-9fb0-41ce-8bfa-a42616c11576 could not be found. Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:15:58.587071 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f137b0e-9fb0-41ce-8bfa-a42616c11576 could not be found. Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f137b0e-9fb0-41ce-8bfa-a42616c11576 could not be found. Aug 30 05:15:58.589114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:15:58.590460 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4a31bd24-858a-42a1-862c-44bd2e75daac tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] Returning 404 to user: Instance 1f137b0e-9fb0-41ce-8bfa-a42616c11576 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:15:58.590460 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4a31bd24-858a-42a1-862c-44bd2e75daac tempest-VolumesSnapshotTestJSON-874921642 tempest-VolumesSnapshotTestJSON-874921642-project] 10.222.0.77 "GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576" status: 404 len: 111 microversion: 2.1 time: 0.037328 Aug 30 05:15:58.591595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 297/566] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:58 2022] GET /compute/v2.1/servers/1f137b0e-9fb0-41ce-8bfa-a42616c11576 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:15:58.634544 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-012c8e79-8b71-456a-94f3-c2eb45ca2882 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:58.643311 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-012c8e79-8b71-456a-94f3-c2eb45ca2882 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1662 microversion: 2.1 time: 0.162651 Aug 30 05:15:58.643899 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 270/567] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:58 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1662 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:59.666833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b0021bb3-238e-472b-bb7b-347da35c6458 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:59.667442 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b0021bb3-238e-472b-bb7b-347da35c6458 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:59.676079 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0021bb3-238e-472b-bb7b-347da35c6458 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:59.676580 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0021bb3-238e-472b-bb7b-347da35c6458 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:59.677377 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0021bb3-238e-472b-bb7b-347da35c6458 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:59.678075 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0021bb3-238e-472b-bb7b-347da35c6458 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:59.678524 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0021bb3-238e-472b-bb7b-347da35c6458 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:59.678976 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0021bb3-238e-472b-bb7b-347da35c6458 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:59.811291 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b0021bb3-238e-472b-bb7b-347da35c6458 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:59.819149 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b0021bb3-238e-472b-bb7b-347da35c6458 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1666 microversion: 2.1 time: 0.158114 Aug 30 05:15:59.819720 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 298/568] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:59 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:01.958224 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9feaf2a4-d9ce-4ad2-9981-3a6e32875d34 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "281369de-4f1e-4820-9b90-f9d189f7623c"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:01.960667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9feaf2a4-d9ce-4ad2-9981-3a6e32875d34 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:01.967942 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9feaf2a4-d9ce-4ad2-9981-3a6e32875d34 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:01.968427 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9feaf2a4-d9ce-4ad2-9981-3a6e32875d34 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:01.968860 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9feaf2a4-d9ce-4ad2-9981-3a6e32875d34 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:01.969543 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9feaf2a4-d9ce-4ad2-9981-3a6e32875d34 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:01.969995 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9feaf2a4-d9ce-4ad2-9981-3a6e32875d34 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:01.970415 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9feaf2a4-d9ce-4ad2-9981-3a6e32875d34 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:03.166661 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9feaf2a4-d9ce-4ad2-9981-3a6e32875d34 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "POST /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.212197 Aug 30 05:16:03.167718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 271/569] 10.222.0.77 () {60 vars in 1323 bytes} [Tue Aug 30 05:16:01 2022] POST /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/os-volume_attachments => generated 194 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:12.812614 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a04d8c40-8a06-461c-8103-0c671e81f261 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:12.814806 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a04d8c40-8a06-461c-8103-0c671e81f261 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:12.817156 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=21 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:12.817797 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:12.823206 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a04d8c40-8a06-461c-8103-0c671e81f261 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:12.823690 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a04d8c40-8a06-461c-8103-0c671e81f261 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:12.824121 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a04d8c40-8a06-461c-8103-0c671e81f261 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:12.824810 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a04d8c40-8a06-461c-8103-0c671e81f261 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:12.825824 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a04d8c40-8a06-461c-8103-0c671e81f261 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:12.826243 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a04d8c40-8a06-461c-8103-0c671e81f261 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:12.849428 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-a04d8c40-8a06-461c-8103-0c671e81f261 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lazy-loading 'flavor' on Instance uuid 30714902-9da4-4ee8-8cb1-bd37f13ce234 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:16:12.969755 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a04d8c40-8a06-461c-8103-0c671e81f261 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "POST /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/action" status: 200 len: 32 microversion: 2.1 time: 0.161472 Aug 30 05:16:12.970357 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 299/570] 10.222.0.77 () {60 vars in 1278 bytes} [Tue Aug 30 05:16:12 2022] POST /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 05:16:12.977757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:12.982532 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ae590e25-669a-48cc-acb4-de91dc3635c8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:12.983298 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ae590e25-669a-48cc-acb4-de91dc3635c8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:12.990227 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae590e25-669a-48cc-acb4-de91dc3635c8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:12.990718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae590e25-669a-48cc-acb4-de91dc3635c8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:12.991193 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae590e25-669a-48cc-acb4-de91dc3635c8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:12.991893 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae590e25-669a-48cc-acb4-de91dc3635c8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:12.992351 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae590e25-669a-48cc-acb4-de91dc3635c8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:12.992776 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ae590e25-669a-48cc-acb4-de91dc3635c8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:13.206856 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ae590e25-669a-48cc-acb4-de91dc3635c8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:13.215167 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ae590e25-669a-48cc-acb4-de91dc3635c8 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.239047 Aug 30 05:16:13.215938 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 272/571] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:12 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:14.237566 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fb72b2a1-0bc0-400e-9cf3-0b1ece0c6557 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:14.238257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fb72b2a1-0bc0-400e-9cf3-0b1ece0c6557 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:14.244380 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb72b2a1-0bc0-400e-9cf3-0b1ece0c6557 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:14.244855 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb72b2a1-0bc0-400e-9cf3-0b1ece0c6557 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:14.245266 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb72b2a1-0bc0-400e-9cf3-0b1ece0c6557 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:14.245953 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb72b2a1-0bc0-400e-9cf3-0b1ece0c6557 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:14.246403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb72b2a1-0bc0-400e-9cf3-0b1ece0c6557 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:14.247342 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fb72b2a1-0bc0-400e-9cf3-0b1ece0c6557 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:14.379124 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fb72b2a1-0bc0-400e-9cf3-0b1ece0c6557 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:14.387199 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fb72b2a1-0bc0-400e-9cf3-0b1ece0c6557 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.154399 Aug 30 05:16:14.387755 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 300/572] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:14 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:15.408817 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-de7814fd-4142-4df0-8384-33316b68e185 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:15.409428 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-de7814fd-4142-4df0-8384-33316b68e185 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:15.415733 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de7814fd-4142-4df0-8384-33316b68e185 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:15.416217 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de7814fd-4142-4df0-8384-33316b68e185 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:15.416683 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de7814fd-4142-4df0-8384-33316b68e185 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:15.417371 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de7814fd-4142-4df0-8384-33316b68e185 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:15.417826 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de7814fd-4142-4df0-8384-33316b68e185 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:15.418250 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-de7814fd-4142-4df0-8384-33316b68e185 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:15.544608 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-de7814fd-4142-4df0-8384-33316b68e185 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:15.552728 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-de7814fd-4142-4df0-8384-33316b68e185 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.147801 Aug 30 05:16:15.553293 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 273/573] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:15 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:16.574025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4671d8d2-d460-4cbe-b1ab-41d52ee1f8ca tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:16.574629 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4671d8d2-d460-4cbe-b1ab-41d52ee1f8ca tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:16.581465 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4671d8d2-d460-4cbe-b1ab-41d52ee1f8ca tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:16.581944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4671d8d2-d460-4cbe-b1ab-41d52ee1f8ca tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:16.582373 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4671d8d2-d460-4cbe-b1ab-41d52ee1f8ca tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:16.583086 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4671d8d2-d460-4cbe-b1ab-41d52ee1f8ca tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:16.583533 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4671d8d2-d460-4cbe-b1ab-41d52ee1f8ca tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:16.583958 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4671d8d2-d460-4cbe-b1ab-41d52ee1f8ca tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:16.712959 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4671d8d2-d460-4cbe-b1ab-41d52ee1f8ca tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:16.722434 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4671d8d2-d460-4cbe-b1ab-41d52ee1f8ca tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.152160 Aug 30 05:16:16.723021 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 301/574] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:16 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:17.743540 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8036f0bc-30f7-47ad-ace3-a787635b863f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:17.744060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8036f0bc-30f7-47ad-ace3-a787635b863f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:17.750334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8036f0bc-30f7-47ad-ace3-a787635b863f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:17.750810 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8036f0bc-30f7-47ad-ace3-a787635b863f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:17.751269 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8036f0bc-30f7-47ad-ace3-a787635b863f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:17.751949 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8036f0bc-30f7-47ad-ace3-a787635b863f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:17.752399 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8036f0bc-30f7-47ad-ace3-a787635b863f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:17.752816 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8036f0bc-30f7-47ad-ace3-a787635b863f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:17.883450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8036f0bc-30f7-47ad-ace3-a787635b863f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:17.891648 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8036f0bc-30f7-47ad-ace3-a787635b863f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.152038 Aug 30 05:16:17.892223 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 274/575] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:17 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:18.912025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-30f4e7b5-c4ca-482f-b7ae-bc6ff4248085 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:18.912641 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-30f4e7b5-c4ca-482f-b7ae-bc6ff4248085 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:18.919045 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30f4e7b5-c4ca-482f-b7ae-bc6ff4248085 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:18.919533 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30f4e7b5-c4ca-482f-b7ae-bc6ff4248085 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:18.919972 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30f4e7b5-c4ca-482f-b7ae-bc6ff4248085 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:18.920662 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30f4e7b5-c4ca-482f-b7ae-bc6ff4248085 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:18.921120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30f4e7b5-c4ca-482f-b7ae-bc6ff4248085 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:18.921544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-30f4e7b5-c4ca-482f-b7ae-bc6ff4248085 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:19.050755 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-30f4e7b5-c4ca-482f-b7ae-bc6ff4248085 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:19.058942 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-30f4e7b5-c4ca-482f-b7ae-bc6ff4248085 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.150834 Aug 30 05:16:19.059507 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 302/576] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:18 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:20.079904 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-39faa29b-a4b6-456e-a909-c75c13a6b57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:20.080520 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-39faa29b-a4b6-456e-a909-c75c13a6b57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:20.086789 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39faa29b-a4b6-456e-a909-c75c13a6b57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:20.087305 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39faa29b-a4b6-456e-a909-c75c13a6b57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:20.087745 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39faa29b-a4b6-456e-a909-c75c13a6b57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:20.088433 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39faa29b-a4b6-456e-a909-c75c13a6b57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:20.088890 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39faa29b-a4b6-456e-a909-c75c13a6b57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:20.089316 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-39faa29b-a4b6-456e-a909-c75c13a6b57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:20.212671 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-39faa29b-a4b6-456e-a909-c75c13a6b57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:20.221564 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-39faa29b-a4b6-456e-a909-c75c13a6b57e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.145592 Aug 30 05:16:20.222129 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 275/577] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:20 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:21.243133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-780beb08-b653-4a59-92f6-f88b435ae458 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:21.243753 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-780beb08-b653-4a59-92f6-f88b435ae458 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:21.250906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-780beb08-b653-4a59-92f6-f88b435ae458 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:21.251376 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-780beb08-b653-4a59-92f6-f88b435ae458 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:21.251815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-780beb08-b653-4a59-92f6-f88b435ae458 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:21.252532 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-780beb08-b653-4a59-92f6-f88b435ae458 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:21.252987 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-780beb08-b653-4a59-92f6-f88b435ae458 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:21.253413 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-780beb08-b653-4a59-92f6-f88b435ae458 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:21.379425 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-780beb08-b653-4a59-92f6-f88b435ae458 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:21.387457 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-780beb08-b653-4a59-92f6-f88b435ae458 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.148238 Aug 30 05:16:21.388023 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 303/578] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:21 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:22.410259 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8806a7a9-b8e7-4078-93bf-3dbe4212cf18 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:22.412208 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8806a7a9-b8e7-4078-93bf-3dbe4212cf18 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:22.419490 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8806a7a9-b8e7-4078-93bf-3dbe4212cf18 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:22.419977 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8806a7a9-b8e7-4078-93bf-3dbe4212cf18 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:22.420578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8806a7a9-b8e7-4078-93bf-3dbe4212cf18 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:22.421487 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8806a7a9-b8e7-4078-93bf-3dbe4212cf18 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:22.421948 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8806a7a9-b8e7-4078-93bf-3dbe4212cf18 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:22.422372 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8806a7a9-b8e7-4078-93bf-3dbe4212cf18 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:22.574733 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8806a7a9-b8e7-4078-93bf-3dbe4212cf18 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:22.584750 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8806a7a9-b8e7-4078-93bf-3dbe4212cf18 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.178995 Aug 30 05:16:22.585323 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 276/579] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:22 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:23.605299 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f1db096e-cabd-4bce-8b49-674704f34e39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:23.605904 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f1db096e-cabd-4bce-8b49-674704f34e39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:23.612346 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1db096e-cabd-4bce-8b49-674704f34e39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:23.612908 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1db096e-cabd-4bce-8b49-674704f34e39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:23.613253 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1db096e-cabd-4bce-8b49-674704f34e39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:23.613935 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1db096e-cabd-4bce-8b49-674704f34e39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:23.614383 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1db096e-cabd-4bce-8b49-674704f34e39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:23.614802 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1db096e-cabd-4bce-8b49-674704f34e39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:23.750532 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f1db096e-cabd-4bce-8b49-674704f34e39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:23.758700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f1db096e-cabd-4bce-8b49-674704f34e39 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.157198 Aug 30 05:16:23.759290 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 304/580] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:23 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:24.357558 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bbcb7c35-18e6-40c4-a348-81c9df3c130e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:24.358109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-bbcb7c35-18e6-40c4-a348-81c9df3c130e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:24.364490 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbcb7c35-18e6-40c4-a348-81c9df3c130e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:24.364971 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbcb7c35-18e6-40c4-a348-81c9df3c130e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:24.365407 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbcb7c35-18e6-40c4-a348-81c9df3c130e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:24.366098 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbcb7c35-18e6-40c4-a348-81c9df3c130e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:24.366557 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbcb7c35-18e6-40c4-a348-81c9df3c130e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:24.367017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-bbcb7c35-18e6-40c4-a348-81c9df3c130e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:24.395728 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bbcb7c35-18e6-40c4-a348-81c9df3c130e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/os-volume_attachments/20941f20-c4e1-4849-b60a-3c0aa5550146" status: 200 len: 194 microversion: 2.20 time: 0.042682 Aug 30 05:16:24.396298 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 277/581] 10.222.0.77 () {60 vars in 1454 bytes} [Tue Aug 30 05:16:24 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/os-volume_attachments/20941f20-c4e1-4849-b60a-3c0aa5550146 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:16:24.461831 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bae6dcbe-71b5-4783-ae0c-81b537b85997 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:24.462404 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bae6dcbe-71b5-4783-ae0c-81b537b85997 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:24.469627 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bae6dcbe-71b5-4783-ae0c-81b537b85997 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:24.470114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bae6dcbe-71b5-4783-ae0c-81b537b85997 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:24.470584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bae6dcbe-71b5-4783-ae0c-81b537b85997 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:24.471308 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bae6dcbe-71b5-4783-ae0c-81b537b85997 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:24.471760 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bae6dcbe-71b5-4783-ae0c-81b537b85997 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:24.472184 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bae6dcbe-71b5-4783-ae0c-81b537b85997 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:24.550738 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-bae6dcbe-71b5-4783-ae0c-81b537b85997 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lazy-loading 'services' on Instance uuid 5f83c589-3a23-45aa-96c5-3cf9006b3830 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:16:24.621282 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bae6dcbe-71b5-4783-ae0c-81b537b85997 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "DELETE /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/os-volume_attachments/20941f20-c4e1-4849-b60a-3c0aa5550146" status: 202 len: 0 microversion: 2.20 time: 0.163267 Aug 30 05:16:24.621852 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 305/582] 10.222.0.77 () {60 vars in 1457 bytes} [Tue Aug 30 05:16:24 2022] DELETE /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/os-volume_attachments/20941f20-c4e1-4849-b60a-3c0aa5550146 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:16:24.630190 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b4c8cac8-76f5-410f-8f1a-eb40117922bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:24.632494 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b4c8cac8-76f5-410f-8f1a-eb40117922bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:24.638725 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4c8cac8-76f5-410f-8f1a-eb40117922bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:24.639246 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4c8cac8-76f5-410f-8f1a-eb40117922bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:24.639680 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4c8cac8-76f5-410f-8f1a-eb40117922bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:24.640374 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4c8cac8-76f5-410f-8f1a-eb40117922bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:24.640849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4c8cac8-76f5-410f-8f1a-eb40117922bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:24.641251 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b4c8cac8-76f5-410f-8f1a-eb40117922bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:24.673673 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b4c8cac8-76f5-410f-8f1a-eb40117922bb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047286 Aug 30 05:16:24.674190 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 278/583] 10.222.0.77 () {60 vars in 1343 bytes} [Tue Aug 30 05:16:24 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:16:24.780937 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-04cd1032-4213-42ac-9078-09a32f193c13 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:24.781667 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-04cd1032-4213-42ac-9078-09a32f193c13 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:24.787748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04cd1032-4213-42ac-9078-09a32f193c13 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:24.788231 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04cd1032-4213-42ac-9078-09a32f193c13 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:24.788669 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04cd1032-4213-42ac-9078-09a32f193c13 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:24.789385 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04cd1032-4213-42ac-9078-09a32f193c13 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:24.789837 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04cd1032-4213-42ac-9078-09a32f193c13 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:24.790261 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04cd1032-4213-42ac-9078-09a32f193c13 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:24.921348 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-04cd1032-4213-42ac-9078-09a32f193c13 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:24.929447 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-04cd1032-4213-42ac-9078-09a32f193c13 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.152738 Aug 30 05:16:24.930009 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 306/584] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:24 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:25.686370 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8a3eb234-c1d0-4e3b-bf33-9ce02afbc200 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:25.688539 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8a3eb234-c1d0-4e3b-bf33-9ce02afbc200 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:25.694838 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a3eb234-c1d0-4e3b-bf33-9ce02afbc200 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:25.695332 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a3eb234-c1d0-4e3b-bf33-9ce02afbc200 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:25.695759 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a3eb234-c1d0-4e3b-bf33-9ce02afbc200 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:25.696437 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a3eb234-c1d0-4e3b-bf33-9ce02afbc200 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:25.696885 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a3eb234-c1d0-4e3b-bf33-9ce02afbc200 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:25.697311 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a3eb234-c1d0-4e3b-bf33-9ce02afbc200 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:25.726334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8a3eb234-c1d0-4e3b-bf33-9ce02afbc200 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043821 Aug 30 05:16:25.726832 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 279/585] 10.222.0.77 () {60 vars in 1343 bytes} [Tue Aug 30 05:16:25 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:25.786117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-987c5cba-d705-40d6-a849-661a34e2974d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:25.786613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-987c5cba-d705-40d6-a849-661a34e2974d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:25.792840 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-987c5cba-d705-40d6-a849-661a34e2974d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:25.793317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-987c5cba-d705-40d6-a849-661a34e2974d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:25.793761 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-987c5cba-d705-40d6-a849-661a34e2974d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:25.794472 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-987c5cba-d705-40d6-a849-661a34e2974d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:25.794948 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-987c5cba-d705-40d6-a849-661a34e2974d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:25.795366 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-987c5cba-d705-40d6-a849-661a34e2974d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:25.819371 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-987c5cba-d705-40d6-a849-661a34e2974d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:16:25.891147 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-987c5cba-d705-40d6-a849-661a34e2974d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "DELETE /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 204 len: 0 microversion: 2.20 time: 0.108526 Aug 30 05:16:25.891725 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 307/586] 10.222.0.77 () {60 vars in 1280 bytes} [Tue Aug 30 05:16:25 2022] DELETE /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 05:16:25.900345 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c7ab334c-7313-4546-b7ea-99aacd2a8632 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:25.900957 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c7ab334c-7313-4546-b7ea-99aacd2a8632 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:25.907474 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7ab334c-7313-4546-b7ea-99aacd2a8632 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:25.907950 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7ab334c-7313-4546-b7ea-99aacd2a8632 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:25.908382 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7ab334c-7313-4546-b7ea-99aacd2a8632 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:25.909074 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7ab334c-7313-4546-b7ea-99aacd2a8632 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:25.909509 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7ab334c-7313-4546-b7ea-99aacd2a8632 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:25.909926 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c7ab334c-7313-4546-b7ea-99aacd2a8632 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:25.952493 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e77e7c2c-2fe1-4c06-931c-3c1e90c68dd2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:25.953203 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e77e7c2c-2fe1-4c06-931c-3c1e90c68dd2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:25.959171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e77e7c2c-2fe1-4c06-931c-3c1e90c68dd2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:25.959657 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e77e7c2c-2fe1-4c06-931c-3c1e90c68dd2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:25.960098 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e77e7c2c-2fe1-4c06-931c-3c1e90c68dd2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:25.960800 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e77e7c2c-2fe1-4c06-931c-3c1e90c68dd2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:25.961255 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e77e7c2c-2fe1-4c06-931c-3c1e90c68dd2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:25.961683 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e77e7c2c-2fe1-4c06-931c-3c1e90c68dd2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:26.041363 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c7ab334c-7313-4546-b7ea-99aacd2a8632 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:26.049493 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c7ab334c-7313-4546-b7ea-99aacd2a8632 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:26.050983 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c7ab334c-7313-4546-b7ea-99aacd2a8632 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:26.052143 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c7ab334c-7313-4546-b7ea-99aacd2a8632 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.155859 Aug 30 05:16:26.052683 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 280/587] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:25 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:16:26.093223 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e77e7c2c-2fe1-4c06-931c-3c1e90c68dd2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:26.101339 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e77e7c2c-2fe1-4c06-931c-3c1e90c68dd2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.153579 Aug 30 05:16:26.101908 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 308/588] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:25 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:16:27.075091 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aec4c238-900b-488f-9563-2a8785a145cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:27.076201 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-aec4c238-900b-488f-9563-2a8785a145cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:27.082448 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aec4c238-900b-488f-9563-2a8785a145cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:27.082963 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aec4c238-900b-488f-9563-2a8785a145cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:27.083401 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aec4c238-900b-488f-9563-2a8785a145cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:27.084092 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aec4c238-900b-488f-9563-2a8785a145cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:27.084543 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aec4c238-900b-488f-9563-2a8785a145cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:27.084965 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aec4c238-900b-488f-9563-2a8785a145cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:27.121390 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0d0cfe84-bae6-4c9d-b616-e0d8822d1b21 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:27.122010 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0d0cfe84-bae6-4c9d-b616-e0d8822d1b21 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:27.128402 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d0cfe84-bae6-4c9d-b616-e0d8822d1b21 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:27.128882 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d0cfe84-bae6-4c9d-b616-e0d8822d1b21 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:27.129314 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d0cfe84-bae6-4c9d-b616-e0d8822d1b21 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:27.129997 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d0cfe84-bae6-4c9d-b616-e0d8822d1b21 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:27.130447 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d0cfe84-bae6-4c9d-b616-e0d8822d1b21 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:27.130901 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0d0cfe84-bae6-4c9d-b616-e0d8822d1b21 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:27.210708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aec4c238-900b-488f-9563-2a8785a145cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:27.219972 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aec4c238-900b-488f-9563-2a8785a145cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:27.221540 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aec4c238-900b-488f-9563-2a8785a145cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:27.222705 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aec4c238-900b-488f-9563-2a8785a145cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1723 microversion: 2.20 time: 0.151547 Aug 30 05:16:27.223299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 281/589] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:27 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:16:27.269818 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0d0cfe84-bae6-4c9d-b616-e0d8822d1b21 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:27.278002 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0d0cfe84-bae6-4c9d-b616-e0d8822d1b21 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.160468 Aug 30 05:16:27.278567 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 309/590] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:27 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:16:28.244748 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3f6bb4c8-e2c1-43fd-8a7c-2f72335e81b0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:28.245664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3f6bb4c8-e2c1-43fd-8a7c-2f72335e81b0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:28.251738 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3f6bb4c8-e2c1-43fd-8a7c-2f72335e81b0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:28.252238 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3f6bb4c8-e2c1-43fd-8a7c-2f72335e81b0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:28.252745 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3f6bb4c8-e2c1-43fd-8a7c-2f72335e81b0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:28.253366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3f6bb4c8-e2c1-43fd-8a7c-2f72335e81b0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:28.253823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3f6bb4c8-e2c1-43fd-8a7c-2f72335e81b0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:28.254248 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3f6bb4c8-e2c1-43fd-8a7c-2f72335e81b0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:28.299579 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cb50c3f8-5ccf-40a0-ab6b-2b1500fb5bce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:28.300188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cb50c3f8-5ccf-40a0-ab6b-2b1500fb5bce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:28.307379 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb50c3f8-5ccf-40a0-ab6b-2b1500fb5bce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:28.307859 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb50c3f8-5ccf-40a0-ab6b-2b1500fb5bce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:28.308472 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb50c3f8-5ccf-40a0-ab6b-2b1500fb5bce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:28.309166 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb50c3f8-5ccf-40a0-ab6b-2b1500fb5bce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:28.309663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb50c3f8-5ccf-40a0-ab6b-2b1500fb5bce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:28.310103 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb50c3f8-5ccf-40a0-ab6b-2b1500fb5bce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:28.322493 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3f6bb4c8-e2c1-43fd-8a7c-2f72335e81b0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:28.332538 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3f6bb4c8-e2c1-43fd-8a7c-2f72335e81b0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:28.334100 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3f6bb4c8-e2c1-43fd-8a7c-2f72335e81b0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:28.335403 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3f6bb4c8-e2c1-43fd-8a7c-2f72335e81b0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1655 microversion: 2.20 time: 0.094541 Aug 30 05:16:28.335961 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 282/591] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:28 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1655 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:16:28.450769 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cb50c3f8-5ccf-40a0-ab6b-2b1500fb5bce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:28.461294 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cb50c3f8-5ccf-40a0-ab6b-2b1500fb5bce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.166340 Aug 30 05:16:28.469509 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 310/592] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:28 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:16:28.800848 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-fa70fcb3-b936-49ad-940c-93db7678d3fc req-c8c7a028-e0b4-4dd3-b99a-38a604449ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f83c589-3a23-45aa-96c5-3cf9006b3830", "name": "network-vif-deleted", "tag": "c5da19b6-98a0-4af9-b8f5-52291d4a9be0"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:28.810590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-fa70fcb3-b936-49ad-940c-93db7678d3fc req-c8c7a028-e0b4-4dd3-b99a-38a604449ed9 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:28.811126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-fa70fcb3-b936-49ad-940c-93db7678d3fc req-c8c7a028-e0b4-4dd3-b99a-38a604449ed9 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:28.812026 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-fa70fcb3-b936-49ad-940c-93db7678d3fc req-c8c7a028-e0b4-4dd3-b99a-38a604449ed9 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:28.816163 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:28.824259 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-fa70fcb3-b936-49ad-940c-93db7678d3fc req-c8c7a028-e0b4-4dd3-b99a-38a604449ed9 service nova] Creating event network-vif-deleted:c5da19b6-98a0-4af9-b8f5-52291d4a9be0 for instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 on hv-cinder-85391 Aug 30 05:16:28.830115 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-fa70fcb3-b936-49ad-940c-93db7678d3fc req-c8c7a028-e0b4-4dd3-b99a-38a604449ed9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032886 Aug 30 05:16:28.831269 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 283/593] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:29.359784 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-df2e7882-4bdd-4aec-8357-3a1775ddb442 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:29.360517 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-df2e7882-4bdd-4aec-8357-3a1775ddb442 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:29.367643 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df2e7882-4bdd-4aec-8357-3a1775ddb442 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:29.368331 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df2e7882-4bdd-4aec-8357-3a1775ddb442 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:29.368768 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df2e7882-4bdd-4aec-8357-3a1775ddb442 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:29.369458 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df2e7882-4bdd-4aec-8357-3a1775ddb442 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:29.370025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df2e7882-4bdd-4aec-8357-3a1775ddb442 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:29.370463 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df2e7882-4bdd-4aec-8357-3a1775ddb442 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:29.375460 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:29.404532 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df2e7882-4bdd-4aec-8357-3a1775ddb442 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:29.405688 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df2e7882-4bdd-4aec-8357-3a1775ddb442 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:29.406136 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-df2e7882-4bdd-4aec-8357-3a1775ddb442 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:29.406592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-df2e7882-4bdd-4aec-8357-3a1775ddb442 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lazy-loading 'fault' on Instance uuid 5f83c589-3a23-45aa-96c5-3cf9006b3830 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:16:29.457571 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-df2e7882-4bdd-4aec-8357-3a1775ddb442 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:29.469442 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-df2e7882-4bdd-4aec-8357-3a1775ddb442 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:29.470943 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-df2e7882-4bdd-4aec-8357-3a1775ddb442 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:29.472164 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-df2e7882-4bdd-4aec-8357-3a1775ddb442 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 200 len: 1371 microversion: 2.20 time: 0.116851 Aug 30 05:16:29.473409 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 311/594] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:29 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 1371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:16:29.485586 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b5ab635d-1989-48ee-93b7-579a7697d9b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:29.486641 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b5ab635d-1989-48ee-93b7-579a7697d9b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:29.500053 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5ab635d-1989-48ee-93b7-579a7697d9b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:29.500693 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5ab635d-1989-48ee-93b7-579a7697d9b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:29.501147 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5ab635d-1989-48ee-93b7-579a7697d9b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:29.501922 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5ab635d-1989-48ee-93b7-579a7697d9b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:29.502453 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5ab635d-1989-48ee-93b7-579a7697d9b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:29.502906 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5ab635d-1989-48ee-93b7-579a7697d9b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:29.675379 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b5ab635d-1989-48ee-93b7-579a7697d9b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:29.683952 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b5ab635d-1989-48ee-93b7-579a7697d9b3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.204122 Aug 30 05:16:29.684724 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 284/595] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:29 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:30.498209 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-172ddf9e-cbec-4815-a14e-00af875422f1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:30.499098 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-172ddf9e-cbec-4815-a14e-00af875422f1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:30.505717 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-172ddf9e-cbec-4815-a14e-00af875422f1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:30.506361 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-172ddf9e-cbec-4815-a14e-00af875422f1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:30.506731 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-172ddf9e-cbec-4815-a14e-00af875422f1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:30.507466 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-172ddf9e-cbec-4815-a14e-00af875422f1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:30.507927 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-172ddf9e-cbec-4815-a14e-00af875422f1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:30.508356 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-172ddf9e-cbec-4815-a14e-00af875422f1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:30.523303 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-172ddf9e-cbec-4815-a14e-00af875422f1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] HTTP exception thrown: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-172ddf9e-cbec-4815-a14e-00af875422f1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Request method failure captured: Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 HTTP/1.1 Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZwl_-AzLktv9UBO21qLWbSU6vb7BZkLMh5hLm0P1OlGuDZbbTyQzPWwTtQ0kxD3e-WS2lSgbqPG7l1Unj1ExmcdV6I8fixfHUk3d4jQdtzDYnuJCmZIyLv4thuTEMOgQ-d18n_gdPJooZxoEBXGRkBfZ_ADEmrEtz7X1JeFVxRKH24 Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 7ea4da0dbf3a44eabbff29f884beb157 Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:16:30.524964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:16:30.526620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_7ea4da0dbf3a44eabbff29f884beb157", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:16:30.526620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:16:30.526620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 7ea4da0dbf3a44eabbff29f884beb157 Aug 30 05:16:30.526620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:16:30.526620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeShelveTestJSON-696047995-project Aug 30 05:16:30.526620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:16:30.526620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:16:30.526620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: 2fe451987a8c49c5b5fc0ef1c9c30ab5 Aug 30 05:16:30.526620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeShelveTestJSON-696047995-project Aug 30 05:16:30.526620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:16:30.526620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. Aug 30 05:16:30.526620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '5f83c589-3a23-45aa-96c5-3cf9006b3830'} Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:16:30.527758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. Aug 30 05:16:30.529014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:16:30.530137 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-172ddf9e-cbec-4815-a14e-00af875422f1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Returning 404 to user: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:16:30.530137 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-172ddf9e-cbec-4815-a14e-00af875422f1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 404 len: 111 microversion: 2.20 time: 0.032624 Aug 30 05:16:30.530137 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 312/596] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:30 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 05:16:30.535374 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-62ce448d-6e57-4932-81bd-9617956c2a6e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '.version_select at 0x7f822ee8edc0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:30.555713 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-62ce448d-6e57-4932-81bd-9617956c2a6e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2073600602" status: 204 len: 0 microversion: 2.20 time: 0.024140 Aug 30 05:16:30.556311 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 285/597] 10.222.0.77 () {60 vars in 1262 bytes} [Tue Aug 30 05:16:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2073600602 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 05:16:30.706566 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a522feef-750f-4ba6-b295-1a13f58399bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:30.707685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a522feef-750f-4ba6-b295-1a13f58399bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:30.714417 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a522feef-750f-4ba6-b295-1a13f58399bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:30.715072 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a522feef-750f-4ba6-b295-1a13f58399bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:30.715714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a522feef-750f-4ba6-b295-1a13f58399bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:30.716656 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a522feef-750f-4ba6-b295-1a13f58399bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:30.717693 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a522feef-750f-4ba6-b295-1a13f58399bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:30.718190 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a522feef-750f-4ba6-b295-1a13f58399bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:30.977074 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a522feef-750f-4ba6-b295-1a13f58399bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:30.985098 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a522feef-750f-4ba6-b295-1a13f58399bc tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.282822 Aug 30 05:16:30.985864 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 313/598] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:30 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:16:31.282175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5c392c99-4f6c-4d9d-9a23-2b9282db502d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Action: 'create', calling method: .version_select at 0x7f822ee1ab80>, body: {"keypair": {"name": "tempest-keypair-955778878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmaborKtUeR+ToDElN/VRfwITPRw4rqPiLuVYhEX8c8680eNxa1KT+xwP1j6SKpiixgYP7EftTaZqh5B25xNZPF0SPf02+fgLes6cwwUHFEsgRQGWXMmZ/TYbKQlMY0Hw=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:31.299430 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-5c392c99-4f6c-4d9d-9a23-2b9282db502d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Getting quotas for project 7ea4da0dbf3a44eabbff29f884beb157. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:16:31.303249 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-5c392c99-4f6c-4d9d-9a23-2b9282db502d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Getting quotas for user 2fe451987a8c49c5b5fc0ef1c9c30ab5 and project 7ea4da0dbf3a44eabbff29f884beb157. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:16:31.325009 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5c392c99-4f6c-4d9d-9a23-2b9282db502d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046832 Aug 30 05:16:31.326230 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 286/599] 10.222.0.77 () {62 vars in 1200 bytes} [Tue Aug 30 05:16:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 05:16:32.006395 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-44d85884-80a4-40fb-b1cc-15dd257381ee tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:32.007078 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-44d85884-80a4-40fb-b1cc-15dd257381ee tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:32.013806 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44d85884-80a4-40fb-b1cc-15dd257381ee tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:32.014298 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44d85884-80a4-40fb-b1cc-15dd257381ee tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:32.014755 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44d85884-80a4-40fb-b1cc-15dd257381ee tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:32.015466 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44d85884-80a4-40fb-b1cc-15dd257381ee tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:32.015918 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44d85884-80a4-40fb-b1cc-15dd257381ee tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:32.016344 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-44d85884-80a4-40fb-b1cc-15dd257381ee tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:32.258728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-44d85884-80a4-40fb-b1cc-15dd257381ee tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:32.266841 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-44d85884-80a4-40fb-b1cc-15dd257381ee tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.264516 Aug 30 05:16:32.267420 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 314/600] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:32 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:32.649045 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-308435067", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fba3e311-e2c8-4947-8745-e286c874d470"}], "security_groups": [{"name": "tempest-securitygroup--1271908590"}], "key_name": "tempest-keypair-955778878", "user_data": "}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:32.750338 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] validate_networks() for [('fba3e311-e2c8-4947-8745-e286c874d470', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:16:33.121595 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:16:33.122018 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:16:33.123152 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:16:33.123559 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:16:33.123967 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:16:33.132676 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:33.133154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:33.133580 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:33.134297 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:33.134749 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:33.135220 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:33.151839 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Getting quotas for project 7ea4da0dbf3a44eabbff29f884beb157. Resources: {'instances', 'ram', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:16:33.155723 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Getting quotas for user 2fe451987a8c49c5b5fc0ef1c9c30ab5 and project 7ea4da0dbf3a44eabbff29f884beb157. Resources: {'instances', 'ram', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:16:33.166359 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:16:33.168630 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:16:33.214636 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-020d7b63-798a-4b1b-a53b-0915a325d1d9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.569903 Aug 30 05:16:33.215296 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 287/601] 10.222.0.77 () {62 vars in 1188 bytes} [Tue Aug 30 05:16:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 05:16:33.227266 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-afbf6d08-4820-4249-b47e-6a2421f5951f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:33.227992 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-afbf6d08-4820-4249-b47e-6a2421f5951f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:33.280893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-afbf6d08-4820-4249-b47e-6a2421f5951f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:33.288830 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-afbf6d08-4820-4249-b47e-6a2421f5951f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:33.289617 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5784d238-b308-4dd4-989c-6828e3514cff tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:33.290281 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-afbf6d08-4820-4249-b47e-6a2421f5951f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:33.290394 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5784d238-b308-4dd4-989c-6828e3514cff tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:33.291424 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-afbf6d08-4820-4249-b47e-6a2421f5951f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1280 microversion: 2.20 time: 0.068128 Aug 30 05:16:33.291989 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 315/602] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:33 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1280 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:16:33.299406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5784d238-b308-4dd4-989c-6828e3514cff tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:33.299903 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5784d238-b308-4dd4-989c-6828e3514cff tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:33.300344 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5784d238-b308-4dd4-989c-6828e3514cff tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:33.301044 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5784d238-b308-4dd4-989c-6828e3514cff tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:33.301680 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5784d238-b308-4dd4-989c-6828e3514cff tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:33.302279 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5784d238-b308-4dd4-989c-6828e3514cff tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:33.437398 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5784d238-b308-4dd4-989c-6828e3514cff tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:33.447056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5784d238-b308-4dd4-989c-6828e3514cff tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.163150 Aug 30 05:16:33.448109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 288/603] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:33 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:16:34.314255 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1380c825-2f91-4ff7-8b3d-c7f77600549d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:34.314890 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1380c825-2f91-4ff7-8b3d-c7f77600549d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:34.321962 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1380c825-2f91-4ff7-8b3d-c7f77600549d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:34.322444 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1380c825-2f91-4ff7-8b3d-c7f77600549d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:34.322907 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1380c825-2f91-4ff7-8b3d-c7f77600549d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:34.323595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1380c825-2f91-4ff7-8b3d-c7f77600549d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:34.324045 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1380c825-2f91-4ff7-8b3d-c7f77600549d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:34.324472 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1380c825-2f91-4ff7-8b3d-c7f77600549d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:34.386850 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1380c825-2f91-4ff7-8b3d-c7f77600549d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:34.395320 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1380c825-2f91-4ff7-8b3d-c7f77600549d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:34.396753 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1380c825-2f91-4ff7-8b3d-c7f77600549d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:34.397877 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1380c825-2f91-4ff7-8b3d-c7f77600549d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1332 microversion: 2.20 time: 0.088083 Aug 30 05:16:34.398455 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 316/604] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:34 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1332 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:16:34.467952 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d14eff65-a088-4145-a44c-5d7a5592c3ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:34.468586 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d14eff65-a088-4145-a44c-5d7a5592c3ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:34.475061 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d14eff65-a088-4145-a44c-5d7a5592c3ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:34.475546 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d14eff65-a088-4145-a44c-5d7a5592c3ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:34.475979 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d14eff65-a088-4145-a44c-5d7a5592c3ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:34.476666 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d14eff65-a088-4145-a44c-5d7a5592c3ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:34.477116 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d14eff65-a088-4145-a44c-5d7a5592c3ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:34.477556 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d14eff65-a088-4145-a44c-5d7a5592c3ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:34.602121 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d14eff65-a088-4145-a44c-5d7a5592c3ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:34.610622 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d14eff65-a088-4145-a44c-5d7a5592c3ce tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.146746 Aug 30 05:16:34.611218 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 289/605] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:34 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:35.420381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-aaae2432-262e-4568-8488-562722bd091f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:35.421059 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-aaae2432-262e-4568-8488-562722bd091f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:35.428195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aaae2432-262e-4568-8488-562722bd091f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:35.428706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aaae2432-262e-4568-8488-562722bd091f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:35.429145 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aaae2432-262e-4568-8488-562722bd091f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:35.430100 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aaae2432-262e-4568-8488-562722bd091f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:35.430360 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aaae2432-262e-4568-8488-562722bd091f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:35.430701 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-aaae2432-262e-4568-8488-562722bd091f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:35.501240 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aaae2432-262e-4568-8488-562722bd091f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:35.519960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aaae2432-262e-4568-8488-562722bd091f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:35.521469 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-aaae2432-262e-4568-8488-562722bd091f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:35.522804 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-aaae2432-262e-4568-8488-562722bd091f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1340 microversion: 2.20 time: 0.106374 Aug 30 05:16:35.523561 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 317/606] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:35 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1340 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:16:35.631388 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cabeb832-253c-4892-8592-a78da52498a6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:35.632013 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cabeb832-253c-4892-8592-a78da52498a6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:35.638932 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cabeb832-253c-4892-8592-a78da52498a6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:35.639424 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cabeb832-253c-4892-8592-a78da52498a6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:35.639867 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cabeb832-253c-4892-8592-a78da52498a6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:35.640565 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cabeb832-253c-4892-8592-a78da52498a6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:35.641024 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cabeb832-253c-4892-8592-a78da52498a6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:35.641451 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cabeb832-253c-4892-8592-a78da52498a6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:35.824017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cabeb832-253c-4892-8592-a78da52498a6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:35.833268 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cabeb832-253c-4892-8592-a78da52498a6 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.205697 Aug 30 05:16:35.833846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 290/607] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:35 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:36.546115 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bf60d02a-ba15-4fd6-9ca9-678b536ca7ee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:36.546723 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bf60d02a-ba15-4fd6-9ca9-678b536ca7ee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:36.553089 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf60d02a-ba15-4fd6-9ca9-678b536ca7ee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:36.553571 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf60d02a-ba15-4fd6-9ca9-678b536ca7ee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:36.554008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf60d02a-ba15-4fd6-9ca9-678b536ca7ee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:36.554697 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf60d02a-ba15-4fd6-9ca9-678b536ca7ee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:36.555178 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf60d02a-ba15-4fd6-9ca9-678b536ca7ee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:36.555600 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf60d02a-ba15-4fd6-9ca9-678b536ca7ee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:36.687201 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bf60d02a-ba15-4fd6-9ca9-678b536ca7ee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:36.695529 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bf60d02a-ba15-4fd6-9ca9-678b536ca7ee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:36.697065 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bf60d02a-ba15-4fd6-9ca9-678b536ca7ee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:36.698396 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bf60d02a-ba15-4fd6-9ca9-678b536ca7ee tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1406 microversion: 2.20 time: 0.156778 Aug 30 05:16:36.699065 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 318/608] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:36 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:16:36.820767 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-d9520dd0-141b-479f-b501-392adee4b44e req-56b7cd15-d4d4-4f7a-badc-9b5c8b63aaf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04bf81ed-0c85-4375-8e3b-eb18b7a48385", "tag": "1ef774e8-0aae-4b74-9370-1e268ea393a2"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:36.830922 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d9520dd0-141b-479f-b501-392adee4b44e req-56b7cd15-d4d4-4f7a-badc-9b5c8b63aaf9 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:36.831411 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d9520dd0-141b-479f-b501-392adee4b44e req-56b7cd15-d4d4-4f7a-badc-9b5c8b63aaf9 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:36.831845 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d9520dd0-141b-479f-b501-392adee4b44e req-56b7cd15-d4d4-4f7a-badc-9b5c8b63aaf9 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:36.842666 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-d9520dd0-141b-479f-b501-392adee4b44e req-56b7cd15-d4d4-4f7a-badc-9b5c8b63aaf9 service nova] Creating event network-changed:1ef774e8-0aae-4b74-9370-1e268ea393a2 for instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 on hv-cinder-85391 Aug 30 05:16:36.849201 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-d9520dd0-141b-479f-b501-392adee4b44e req-56b7cd15-d4d4-4f7a-badc-9b5c8b63aaf9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032386 Aug 30 05:16:36.849809 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 291/609] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:16:36.863950 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-09e6cfbf-50a3-47ae-9640-7dbff7c2e58e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:36.864662 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-09e6cfbf-50a3-47ae-9640-7dbff7c2e58e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:36.870840 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09e6cfbf-50a3-47ae-9640-7dbff7c2e58e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:36.871412 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09e6cfbf-50a3-47ae-9640-7dbff7c2e58e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:36.871978 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09e6cfbf-50a3-47ae-9640-7dbff7c2e58e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:36.873350 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09e6cfbf-50a3-47ae-9640-7dbff7c2e58e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:36.873876 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09e6cfbf-50a3-47ae-9640-7dbff7c2e58e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:36.874383 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09e6cfbf-50a3-47ae-9640-7dbff7c2e58e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:37.015563 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-09e6cfbf-50a3-47ae-9640-7dbff7c2e58e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:37.024135 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-09e6cfbf-50a3-47ae-9640-7dbff7c2e58e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1737 microversion: 2.1 time: 0.172895 Aug 30 05:16:37.024967 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 319/610] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:36 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:37.722074 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1a82f7b6-05ae-44fa-85bb-b10368bacabe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:37.722698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1a82f7b6-05ae-44fa-85bb-b10368bacabe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:37.728900 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a82f7b6-05ae-44fa-85bb-b10368bacabe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:37.729386 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a82f7b6-05ae-44fa-85bb-b10368bacabe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:37.729826 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a82f7b6-05ae-44fa-85bb-b10368bacabe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:37.730515 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a82f7b6-05ae-44fa-85bb-b10368bacabe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:37.731012 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a82f7b6-05ae-44fa-85bb-b10368bacabe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:37.731438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1a82f7b6-05ae-44fa-85bb-b10368bacabe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:37.859808 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1a82f7b6-05ae-44fa-85bb-b10368bacabe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:37.867924 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1a82f7b6-05ae-44fa-85bb-b10368bacabe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:37.869358 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1a82f7b6-05ae-44fa-85bb-b10368bacabe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:37.870462 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1a82f7b6-05ae-44fa-85bb-b10368bacabe tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1406 microversion: 2.20 time: 0.152788 Aug 30 05:16:37.871081 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 292/611] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:37 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:16:38.045376 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a911abaa-270e-46a2-9d4a-56030f1cbce2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:38.045997 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a911abaa-270e-46a2-9d4a-56030f1cbce2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:38.052457 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a911abaa-270e-46a2-9d4a-56030f1cbce2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:38.052944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a911abaa-270e-46a2-9d4a-56030f1cbce2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:38.053438 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a911abaa-270e-46a2-9d4a-56030f1cbce2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:38.054160 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a911abaa-270e-46a2-9d4a-56030f1cbce2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:38.054625 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a911abaa-270e-46a2-9d4a-56030f1cbce2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:38.055087 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a911abaa-270e-46a2-9d4a-56030f1cbce2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:38.179933 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a911abaa-270e-46a2-9d4a-56030f1cbce2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:38.188091 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a911abaa-270e-46a2-9d4a-56030f1cbce2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1717 microversion: 2.1 time: 0.147225 Aug 30 05:16:38.188660 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 320/612] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:38 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1717 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:38.296366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-448b8ed8-932f-4b14-9840-08531220fad1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:38.296802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-448b8ed8-932f-4b14-9840-08531220fad1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:38.302684 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-448b8ed8-932f-4b14-9840-08531220fad1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:38.303203 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-448b8ed8-932f-4b14-9840-08531220fad1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:38.303640 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-448b8ed8-932f-4b14-9840-08531220fad1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:38.304326 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-448b8ed8-932f-4b14-9840-08531220fad1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:38.304783 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-448b8ed8-932f-4b14-9840-08531220fad1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:38.305210 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-448b8ed8-932f-4b14-9840-08531220fad1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:38.384914 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-448b8ed8-932f-4b14-9840-08531220fad1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] HTTP exception thrown: Cannot 'detach_volume' instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 while it is in vm_state rescued Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-448b8ed8-932f-4b14-9840-08531220fad1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Request method failure captured: Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/os-volume_attachments/281369de-4f1e-4820-9b90-f9d189f7623c HTTP/1.1 Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZwmh_DDwRU_BEVybRcQ6moSB8pHRQiYw6M2nPThYf10X2ijKHRbdaToX7zYPI-l6N6xyuqYMKqMjKZm748svv5LhMk4_YqUXJlUw5ALU6ysD7iSFrCxa6aOOZC9I2TnhN2vvAfWp7CNt0MAA0G45_k3r-EKMDgIQuxnO7y2pB0I1EQ Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: d2ce224c162c414c9be681b76801969c Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802004164 Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:16:38.386634 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:16:38.388752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/d2ce224c162c414c9be681b76801969c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/d2ce224c162c414c9be681b76801969c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/d2ce224c162c414c9be681b76801969c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_d2ce224c162c414c9be681b76801969c", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:16:38.388752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802004164 Aug 30 05:16:38.388752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: d2ce224c162c414c9be681b76801969c Aug 30 05:16:38.388752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802004164 Aug 30 05:16:38.388752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-ServerRescueNegativeTestJSON-1802004164-project Aug 30 05:16:38.388752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:16:38.388752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:16:38.388752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: 31cc6aa564be4c569e6fa89813cb9329 Aug 30 05:16:38.388752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802004164-project Aug 30 05:16:38.388752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:16:38.388752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Cannot 'detach_volume' instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 while it is in vm_state rescued Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'server_id': '30714902-9da4-4ee8-8cb1-bd37f13ce234', 'id': '281369de-4f1e-4820-9b90-f9d189f7623c'} Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:16:38.389514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:16:38.390796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 05:16:38.390796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 05:16:38.390796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 05:16:38.390796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 05:16:38.390796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 while it is in vm_state rescued Aug 30 05:16:38.390796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:16:38.390796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:16:38.390796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:16:38.390796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:38.390796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:16:38.390796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:16:38.390796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:16:38.390796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:16:38.390796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 while it is in vm_state rescued Aug 30 05:16:38.390796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:16:38.390796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-448b8ed8-932f-4b14-9840-08531220fad1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Returning 409 to user: Cannot 'detach_volume' instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 while it is in vm_state rescued {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:16:38.391938 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-448b8ed8-932f-4b14-9840-08531220fad1 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "DELETE /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/os-volume_attachments/281369de-4f1e-4820-9b90-f9d189f7623c" status: 409 len: 152 microversion: 2.1 time: 0.096375 Aug 30 05:16:38.391938 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 293/613] 10.222.0.77 () {58 vars in 1416 bytes} [Tue Aug 30 05:16:38 2022] DELETE /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/os-volume_attachments/281369de-4f1e-4820-9b90-f9d189f7623c => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 05:16:38.397485 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8e647c0d-a3a0-48ad-bae8-da05a28e61ae tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:38.398032 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8e647c0d-a3a0-48ad-bae8-da05a28e61ae tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:38.403865 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8e647c0d-a3a0-48ad-bae8-da05a28e61ae tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:38.404973 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8e647c0d-a3a0-48ad-bae8-da05a28e61ae tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:38.405446 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8e647c0d-a3a0-48ad-bae8-da05a28e61ae tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:38.406133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8e647c0d-a3a0-48ad-bae8-da05a28e61ae tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:38.406590 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8e647c0d-a3a0-48ad-bae8-da05a28e61ae tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:38.407041 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8e647c0d-a3a0-48ad-bae8-da05a28e61ae tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:38.475047 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8e647c0d-a3a0-48ad-bae8-da05a28e61ae tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "POST /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/action" status: 202 len: 0 microversion: 2.1 time: 0.081173 Aug 30 05:16:38.475682 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 321/614] 10.222.0.77 () {60 vars in 1278 bytes} [Tue Aug 30 05:16:38 2022] POST /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:16:38.483853 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e0034021-b508-441f-94d4-908db89d500f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:38.484618 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e0034021-b508-441f-94d4-908db89d500f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:38.490855 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0034021-b508-441f-94d4-908db89d500f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:38.491321 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0034021-b508-441f-94d4-908db89d500f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:38.491782 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0034021-b508-441f-94d4-908db89d500f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:38.492463 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0034021-b508-441f-94d4-908db89d500f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:38.492924 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0034021-b508-441f-94d4-908db89d500f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:38.493441 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e0034021-b508-441f-94d4-908db89d500f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:38.707435 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e0034021-b508-441f-94d4-908db89d500f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:38.715660 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e0034021-b508-441f-94d4-908db89d500f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1725 microversion: 2.1 time: 0.235694 Aug 30 05:16:38.716233 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 294/615] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:38 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:38.893599 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cdc145c6-b7b4-4ea2-89c6-9c5fac6db06e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:38.894337 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cdc145c6-b7b4-4ea2-89c6-9c5fac6db06e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:38.900404 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cdc145c6-b7b4-4ea2-89c6-9c5fac6db06e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:38.900886 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cdc145c6-b7b4-4ea2-89c6-9c5fac6db06e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:38.901319 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cdc145c6-b7b4-4ea2-89c6-9c5fac6db06e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:38.902008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cdc145c6-b7b4-4ea2-89c6-9c5fac6db06e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:38.902466 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cdc145c6-b7b4-4ea2-89c6-9c5fac6db06e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:38.902914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cdc145c6-b7b4-4ea2-89c6-9c5fac6db06e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:39.030927 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cdc145c6-b7b4-4ea2-89c6-9c5fac6db06e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:39.039107 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cdc145c6-b7b4-4ea2-89c6-9c5fac6db06e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:39.040554 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cdc145c6-b7b4-4ea2-89c6-9c5fac6db06e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:39.041700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cdc145c6-b7b4-4ea2-89c6-9c5fac6db06e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1406 microversion: 2.20 time: 0.152346 Aug 30 05:16:39.042291 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 322/616] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:38 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:16:39.737428 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0ad75fb8-8947-4c70-81de-63a38e4e584d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:39.738045 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0ad75fb8-8947-4c70-81de-63a38e4e584d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:39.744594 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ad75fb8-8947-4c70-81de-63a38e4e584d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:39.745079 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ad75fb8-8947-4c70-81de-63a38e4e584d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:39.745519 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ad75fb8-8947-4c70-81de-63a38e4e584d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:39.746211 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ad75fb8-8947-4c70-81de-63a38e4e584d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:39.746668 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ad75fb8-8947-4c70-81de-63a38e4e584d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:39.747123 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ad75fb8-8947-4c70-81de-63a38e4e584d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:39.874294 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0ad75fb8-8947-4c70-81de-63a38e4e584d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:39.882313 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0ad75fb8-8947-4c70-81de-63a38e4e584d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1725 microversion: 2.1 time: 0.148761 Aug 30 05:16:39.882894 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 295/617] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:39 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:40.065215 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-929aef40-29d1-4df5-8071-ace142496b5f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:40.065820 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-929aef40-29d1-4df5-8071-ace142496b5f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:40.072150 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-929aef40-29d1-4df5-8071-ace142496b5f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:40.072629 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-929aef40-29d1-4df5-8071-ace142496b5f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:40.073059 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-929aef40-29d1-4df5-8071-ace142496b5f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:40.073740 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-929aef40-29d1-4df5-8071-ace142496b5f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:40.074188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-929aef40-29d1-4df5-8071-ace142496b5f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:40.074607 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-929aef40-29d1-4df5-8071-ace142496b5f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:40.204966 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-929aef40-29d1-4df5-8071-ace142496b5f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:40.212955 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-929aef40-29d1-4df5-8071-ace142496b5f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:40.214384 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-929aef40-29d1-4df5-8071-ace142496b5f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:40.215493 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-929aef40-29d1-4df5-8071-ace142496b5f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1406 microversion: 2.20 time: 0.154149 Aug 30 05:16:40.216042 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 323/618] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:40 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:16:40.904973 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-24cba7c2-47e7-4c63-9fbd-2b2153dbbced tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:40.905587 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-24cba7c2-47e7-4c63-9fbd-2b2153dbbced tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:40.911996 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24cba7c2-47e7-4c63-9fbd-2b2153dbbced tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:40.912481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24cba7c2-47e7-4c63-9fbd-2b2153dbbced tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:40.912915 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24cba7c2-47e7-4c63-9fbd-2b2153dbbced tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:40.913622 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24cba7c2-47e7-4c63-9fbd-2b2153dbbced tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:40.914064 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24cba7c2-47e7-4c63-9fbd-2b2153dbbced tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:40.914490 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-24cba7c2-47e7-4c63-9fbd-2b2153dbbced tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:41.039667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-24cba7c2-47e7-4c63-9fbd-2b2153dbbced tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:41.048416 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-24cba7c2-47e7-4c63-9fbd-2b2153dbbced tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1731 microversion: 2.1 time: 0.147947 Aug 30 05:16:41.048986 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 296/619] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:40 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:41.068568 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-316fccc4-8b37-4d47-9326-863e3051147d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:41.069069 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-316fccc4-8b37-4d47-9326-863e3051147d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:41.075433 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-316fccc4-8b37-4d47-9326-863e3051147d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:41.075961 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-316fccc4-8b37-4d47-9326-863e3051147d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:41.076396 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-316fccc4-8b37-4d47-9326-863e3051147d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:41.077078 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-316fccc4-8b37-4d47-9326-863e3051147d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:41.077658 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-316fccc4-8b37-4d47-9326-863e3051147d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:41.078221 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-316fccc4-8b37-4d47-9326-863e3051147d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:41.136628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2f6f11ba-357f-490d-acdf-d445c8ef38c2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:41.138968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2f6f11ba-357f-490d-acdf-d445c8ef38c2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:41.145134 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6f11ba-357f-490d-acdf-d445c8ef38c2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:41.145626 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6f11ba-357f-490d-acdf-d445c8ef38c2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:41.146066 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6f11ba-357f-490d-acdf-d445c8ef38c2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:41.146769 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6f11ba-357f-490d-acdf-d445c8ef38c2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:41.147259 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6f11ba-357f-490d-acdf-d445c8ef38c2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:41.147683 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2f6f11ba-357f-490d-acdf-d445c8ef38c2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:41.157331 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-316fccc4-8b37-4d47-9326-863e3051147d tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092552 Aug 30 05:16:41.158052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 324/620] 10.222.0.77 () {58 vars in 1275 bytes} [Tue Aug 30 05:16:41 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:41.178809 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2f6f11ba-357f-490d-acdf-d445c8ef38c2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046092 Aug 30 05:16:41.179590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 297/621] 10.222.0.77 () {58 vars in 1302 bytes} [Tue Aug 30 05:16:41 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 05:16:41.245912 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7885cee7-ddf1-484c-bbdb-052c4961ba04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:41.245912 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7885cee7-ddf1-484c-bbdb-052c4961ba04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:41.255325 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-77e9b83e-2daf-40fe-a7d7-c18de915389b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:41.257695 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7885cee7-ddf1-484c-bbdb-052c4961ba04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:41.258199 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7885cee7-ddf1-484c-bbdb-052c4961ba04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:41.258644 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7885cee7-ddf1-484c-bbdb-052c4961ba04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:41.259401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7885cee7-ddf1-484c-bbdb-052c4961ba04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:41.259849 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7885cee7-ddf1-484c-bbdb-052c4961ba04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:41.260280 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7885cee7-ddf1-484c-bbdb-052c4961ba04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:41.262165 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-77e9b83e-2daf-40fe-a7d7-c18de915389b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:41.272993 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77e9b83e-2daf-40fe-a7d7-c18de915389b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:41.273745 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77e9b83e-2daf-40fe-a7d7-c18de915389b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:41.274182 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77e9b83e-2daf-40fe-a7d7-c18de915389b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:41.274957 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77e9b83e-2daf-40fe-a7d7-c18de915389b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:41.275417 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77e9b83e-2daf-40fe-a7d7-c18de915389b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:41.275847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-77e9b83e-2daf-40fe-a7d7-c18de915389b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:41.315433 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-77e9b83e-2daf-40fe-a7d7-c18de915389b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:16:41.414971 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-77e9b83e-2daf-40fe-a7d7-c18de915389b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 204 len: 0 microversion: 2.1 time: 0.163311 Aug 30 05:16:41.416899 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 298/622] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:16:41 2022] DELETE /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:16:41.426917 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2856c023-f5b0-4d20-9732-a32dc89a7706 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:41.427643 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2856c023-f5b0-4d20-9732-a32dc89a7706 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:41.438588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856c023-f5b0-4d20-9732-a32dc89a7706 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:41.439742 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856c023-f5b0-4d20-9732-a32dc89a7706 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:41.440300 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856c023-f5b0-4d20-9732-a32dc89a7706 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:41.441705 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856c023-f5b0-4d20-9732-a32dc89a7706 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:41.442304 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856c023-f5b0-4d20-9732-a32dc89a7706 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:41.443505 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2856c023-f5b0-4d20-9732-a32dc89a7706 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:41.450521 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7885cee7-ddf1-484c-bbdb-052c4961ba04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:41.459037 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7885cee7-ddf1-484c-bbdb-052c4961ba04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:41.460415 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7885cee7-ddf1-484c-bbdb-052c4961ba04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:41.464041 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7885cee7-ddf1-484c-bbdb-052c4961ba04 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1406 microversion: 2.20 time: 0.229977 Aug 30 05:16:41.478865 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 325/623] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:41 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:16:41.711715 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2856c023-f5b0-4d20-9732-a32dc89a7706 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:41.720949 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2856c023-f5b0-4d20-9732-a32dc89a7706 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1672 microversion: 2.1 time: 0.298992 Aug 30 05:16:41.721896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 299/624] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:41 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1672 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:42.424462 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-9d0c2dd3-d733-4874-b5d5-a4bd935ada49 req-e8254059-7138-4f66-b604-fcc422c51512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30714902-9da4-4ee8-8cb1-bd37f13ce234", "tag": "361c8508-8cc9-4e2d-95e0-07af85e45dfa"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:42.436129 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-9d0c2dd3-d733-4874-b5d5-a4bd935ada49 req-e8254059-7138-4f66-b604-fcc422c51512 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:42.436610 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-9d0c2dd3-d733-4874-b5d5-a4bd935ada49 req-e8254059-7138-4f66-b604-fcc422c51512 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:42.437043 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-9d0c2dd3-d733-4874-b5d5-a4bd935ada49 req-e8254059-7138-4f66-b604-fcc422c51512 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:42.452830 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-9d0c2dd3-d733-4874-b5d5-a4bd935ada49 req-e8254059-7138-4f66-b604-fcc422c51512 service nova] Creating event network-changed:361c8508-8cc9-4e2d-95e0-07af85e45dfa for instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 on hv-cinder-85391 Aug 30 05:16:42.457964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-9d0c2dd3-d733-4874-b5d5-a4bd935ada49 req-e8254059-7138-4f66-b604-fcc422c51512 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037585 Aug 30 05:16:42.458563 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 326/625] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:42.489394 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ef29fc98-8bf6-4012-9a1b-3ec888519d61 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:42.490258 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ef29fc98-8bf6-4012-9a1b-3ec888519d61 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:42.498024 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef29fc98-8bf6-4012-9a1b-3ec888519d61 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:42.498650 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef29fc98-8bf6-4012-9a1b-3ec888519d61 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:42.499166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef29fc98-8bf6-4012-9a1b-3ec888519d61 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:42.499947 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef29fc98-8bf6-4012-9a1b-3ec888519d61 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:42.500480 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef29fc98-8bf6-4012-9a1b-3ec888519d61 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:42.500976 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef29fc98-8bf6-4012-9a1b-3ec888519d61 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:42.641699 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ef29fc98-8bf6-4012-9a1b-3ec888519d61 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:42.649865 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ef29fc98-8bf6-4012-9a1b-3ec888519d61 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:42.651477 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ef29fc98-8bf6-4012-9a1b-3ec888519d61 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:42.652674 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ef29fc98-8bf6-4012-9a1b-3ec888519d61 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1406 microversion: 2.20 time: 0.167475 Aug 30 05:16:42.653244 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 300/626] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:42 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:16:42.742699 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-63cc70ef-63a5-486e-8068-4891f0560f90 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:42.743433 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-63cc70ef-63a5-486e-8068-4891f0560f90 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:42.750266 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63cc70ef-63a5-486e-8068-4891f0560f90 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:42.750751 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63cc70ef-63a5-486e-8068-4891f0560f90 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:42.751213 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63cc70ef-63a5-486e-8068-4891f0560f90 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:42.751911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63cc70ef-63a5-486e-8068-4891f0560f90 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:42.752366 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63cc70ef-63a5-486e-8068-4891f0560f90 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:42.752791 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-63cc70ef-63a5-486e-8068-4891f0560f90 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:43.089012 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-63cc70ef-63a5-486e-8068-4891f0560f90 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:43.097753 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-63cc70ef-63a5-486e-8068-4891f0560f90 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1672 microversion: 2.1 time: 0.359843 Aug 30 05:16:43.098417 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 327/627] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:42 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1672 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:43.406692 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-c8b034b6-0b89-4f79-bc6e-ad8fcb11ee62 req-c994a408-3a4f-41b3-b11e-bc39d6c1e257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bf81ed-0c85-4375-8e3b-eb18b7a48385", "name": "network-vif-plugged", "status": "completed", "tag": "1ef774e8-0aae-4b74-9370-1e268ea393a2"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:43.413072 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:43.413726 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=10 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:43.414528 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:43.419039 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c8b034b6-0b89-4f79-bc6e-ad8fcb11ee62 req-c994a408-3a4f-41b3-b11e-bc39d6c1e257 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:43.419588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c8b034b6-0b89-4f79-bc6e-ad8fcb11ee62 req-c994a408-3a4f-41b3-b11e-bc39d6c1e257 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:43.420183 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c8b034b6-0b89-4f79-bc6e-ad8fcb11ee62 req-c994a408-3a4f-41b3-b11e-bc39d6c1e257 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:43.434791 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-c8b034b6-0b89-4f79-bc6e-ad8fcb11ee62 req-c994a408-3a4f-41b3-b11e-bc39d6c1e257 service nova] Creating event network-vif-plugged:1ef774e8-0aae-4b74-9370-1e268ea393a2 for instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 on hv-cinder-85391 Aug 30 05:16:43.440798 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-c8b034b6-0b89-4f79-bc6e-ad8fcb11ee62 req-c994a408-3a4f-41b3-b11e-bc39d6c1e257 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037525 Aug 30 05:16:43.441573 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 301/628] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:43.675507 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-da07161c-4c1b-4761-92fd-074d01f1cb88 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:43.676136 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-da07161c-4c1b-4761-92fd-074d01f1cb88 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:43.678101 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:43.679288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:43.686550 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da07161c-4c1b-4761-92fd-074d01f1cb88 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:43.687137 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da07161c-4c1b-4761-92fd-074d01f1cb88 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:43.687569 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da07161c-4c1b-4761-92fd-074d01f1cb88 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:43.688267 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da07161c-4c1b-4761-92fd-074d01f1cb88 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:43.688710 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da07161c-4c1b-4761-92fd-074d01f1cb88 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:43.689131 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-da07161c-4c1b-4761-92fd-074d01f1cb88 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:43.816871 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-da07161c-4c1b-4761-92fd-074d01f1cb88 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:43.824931 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-da07161c-4c1b-4761-92fd-074d01f1cb88 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:43.826352 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-da07161c-4c1b-4761-92fd-074d01f1cb88 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:43.827469 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-da07161c-4c1b-4761-92fd-074d01f1cb88 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1406 microversion: 2.20 time: 0.155938 Aug 30 05:16:43.828388 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 328/629] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:43 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:16:44.120520 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c09d8959-cb04-4cc9-9506-4ad086ea92ba tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:44.121342 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c09d8959-cb04-4cc9-9506-4ad086ea92ba tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:44.128578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c09d8959-cb04-4cc9-9506-4ad086ea92ba tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:44.129069 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c09d8959-cb04-4cc9-9506-4ad086ea92ba tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:44.129500 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c09d8959-cb04-4cc9-9506-4ad086ea92ba tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:44.130198 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c09d8959-cb04-4cc9-9506-4ad086ea92ba tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:44.130652 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c09d8959-cb04-4cc9-9506-4ad086ea92ba tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:44.131097 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c09d8959-cb04-4cc9-9506-4ad086ea92ba tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:44.336632 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c09d8959-cb04-4cc9-9506-4ad086ea92ba tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:44.339091 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:44.347702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c09d8959-cb04-4cc9-9506-4ad086ea92ba tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1672 microversion: 2.1 time: 0.232561 Aug 30 05:16:44.348283 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 302/630] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:44 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1672 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:44.487704 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-575ab216-bf1e-4db1-aa9b-fedd95e38dc4 req-40df30e5-eedc-4b9e-bf2a-1c554f0e8f62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30714902-9da4-4ee8-8cb1-bd37f13ce234", "tag": "361c8508-8cc9-4e2d-95e0-07af85e45dfa"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:44.497305 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-575ab216-bf1e-4db1-aa9b-fedd95e38dc4 req-40df30e5-eedc-4b9e-bf2a-1c554f0e8f62 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:44.497779 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-575ab216-bf1e-4db1-aa9b-fedd95e38dc4 req-40df30e5-eedc-4b9e-bf2a-1c554f0e8f62 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:44.498208 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-575ab216-bf1e-4db1-aa9b-fedd95e38dc4 req-40df30e5-eedc-4b9e-bf2a-1c554f0e8f62 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:44.502020 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:44.509834 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-575ab216-bf1e-4db1-aa9b-fedd95e38dc4 req-40df30e5-eedc-4b9e-bf2a-1c554f0e8f62 service nova] Creating event network-changed:361c8508-8cc9-4e2d-95e0-07af85e45dfa for instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 on hv-cinder-85391 Aug 30 05:16:44.515215 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-575ab216-bf1e-4db1-aa9b-fedd95e38dc4 req-40df30e5-eedc-4b9e-bf2a-1c554f0e8f62 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031194 Aug 30 05:16:44.515805 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 329/631] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:44.856618 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a4a5b0fb-b4ef-4f6f-a94a-86b50ebaa143 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:44.858321 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a4a5b0fb-b4ef-4f6f-a94a-86b50ebaa143 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:44.870182 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4a5b0fb-b4ef-4f6f-a94a-86b50ebaa143 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:44.873315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4a5b0fb-b4ef-4f6f-a94a-86b50ebaa143 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:44.874157 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4a5b0fb-b4ef-4f6f-a94a-86b50ebaa143 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:44.875371 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4a5b0fb-b4ef-4f6f-a94a-86b50ebaa143 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:44.876152 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4a5b0fb-b4ef-4f6f-a94a-86b50ebaa143 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:44.876736 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a4a5b0fb-b4ef-4f6f-a94a-86b50ebaa143 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:45.022314 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a4a5b0fb-b4ef-4f6f-a94a-86b50ebaa143 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:45.030807 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a4a5b0fb-b4ef-4f6f-a94a-86b50ebaa143 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:45.032268 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a4a5b0fb-b4ef-4f6f-a94a-86b50ebaa143 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:45.033366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a4a5b0fb-b4ef-4f6f-a94a-86b50ebaa143 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1406 microversion: 2.20 time: 0.187581 Aug 30 05:16:45.033917 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 303/632] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:44 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:16:45.369010 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-466d1ab6-c918-41e0-b0fb-184f3a452dd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:45.371217 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-466d1ab6-c918-41e0-b0fb-184f3a452dd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:45.386863 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-466d1ab6-c918-41e0-b0fb-184f3a452dd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:45.387348 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-466d1ab6-c918-41e0-b0fb-184f3a452dd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:45.387785 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-466d1ab6-c918-41e0-b0fb-184f3a452dd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:45.389037 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-466d1ab6-c918-41e0-b0fb-184f3a452dd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:45.389491 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-466d1ab6-c918-41e0-b0fb-184f3a452dd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:45.389912 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-466d1ab6-c918-41e0-b0fb-184f3a452dd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:45.460786 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-466d1ab6-c918-41e0-b0fb-184f3a452dd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:45.465656 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-466d1ab6-c918-41e0-b0fb-184f3a452dd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:45.465848 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-466d1ab6-c918-41e0-b0fb-184f3a452dd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:45.466480 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-466d1ab6-c918-41e0-b0fb-184f3a452dd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lazy-loading 'fault' on Instance uuid 2a54dc6f-8cee-4b66-9486-491841d01c27 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:16:45.540468 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-466d1ab6-c918-41e0-b0fb-184f3a452dd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:45.549039 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-466d1ab6-c918-41e0-b0fb-184f3a452dd0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 200 len: 1326 microversion: 2.1 time: 0.184466 Aug 30 05:16:45.549691 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 330/633] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:45 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 1326 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:46.056719 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-09bd90fb-b204-4370-88c9-6a6373abb734 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:46.057335 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-09bd90fb-b204-4370-88c9-6a6373abb734 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:46.063717 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09bd90fb-b204-4370-88c9-6a6373abb734 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:46.064204 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09bd90fb-b204-4370-88c9-6a6373abb734 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:46.064644 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09bd90fb-b204-4370-88c9-6a6373abb734 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:46.065335 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09bd90fb-b204-4370-88c9-6a6373abb734 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:46.065793 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09bd90fb-b204-4370-88c9-6a6373abb734 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:46.066235 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-09bd90fb-b204-4370-88c9-6a6373abb734 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:46.193453 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-09bd90fb-b204-4370-88c9-6a6373abb734 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:46.201932 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-09bd90fb-b204-4370-88c9-6a6373abb734 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:46.203399 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-09bd90fb-b204-4370-88c9-6a6373abb734 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:46.204544 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-09bd90fb-b204-4370-88c9-6a6373abb734 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1597 microversion: 2.20 time: 0.151813 Aug 30 05:16:46.205102 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 304/634] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:16:46 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1597 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:16:46.226259 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d256912f-7cc2-4358-a613-bb995a0da6d3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:46.226757 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d256912f-7cc2-4358-a613-bb995a0da6d3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:46.232609 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d256912f-7cc2-4358-a613-bb995a0da6d3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:46.233083 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d256912f-7cc2-4358-a613-bb995a0da6d3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:46.233513 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d256912f-7cc2-4358-a613-bb995a0da6d3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:46.234197 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d256912f-7cc2-4358-a613-bb995a0da6d3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:46.234647 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d256912f-7cc2-4358-a613-bb995a0da6d3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:46.235104 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d256912f-7cc2-4358-a613-bb995a0da6d3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:46.308870 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d256912f-7cc2-4358-a613-bb995a0da6d3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.086416 Aug 30 05:16:46.309493 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 331/635] 10.222.0.77 () {60 vars in 1316 bytes} [Tue Aug 30 05:16:46 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:16:46.538127 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-8f7e57ae-c3b3-4543-a8a5-db6f7e617c71 req-2102415e-b9fd-4cc5-a9ae-400b13f655ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a54dc6f-8cee-4b66-9486-491841d01c27", "name": "network-vif-deleted", "tag": "a8fa1465-9fa9-4b85-9370-89b6902a982d"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:46.547874 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-8f7e57ae-c3b3-4543-a8a5-db6f7e617c71 req-2102415e-b9fd-4cc5-a9ae-400b13f655ff service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:46.548349 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-8f7e57ae-c3b3-4543-a8a5-db6f7e617c71 req-2102415e-b9fd-4cc5-a9ae-400b13f655ff service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:46.548773 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-8f7e57ae-c3b3-4543-a8a5-db6f7e617c71 req-2102415e-b9fd-4cc5-a9ae-400b13f655ff service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:46.559342 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-8f7e57ae-c3b3-4543-a8a5-db6f7e617c71 req-2102415e-b9fd-4cc5-a9ae-400b13f655ff service nova] Creating event network-vif-deleted:a8fa1465-9fa9-4b85-9370-89b6902a982d for instance 2a54dc6f-8cee-4b66-9486-491841d01c27 on hv-cinder-85391 Aug 30 05:16:46.564043 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-8f7e57ae-c3b3-4543-a8a5-db6f7e617c71 req-2102415e-b9fd-4cc5-a9ae-400b13f655ff service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029621 Aug 30 05:16:46.564796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 305/636] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:46.570064 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3b205ac4-399e-4579-84ca-0780bf6d1616 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:46.570679 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3b205ac4-399e-4579-84ca-0780bf6d1616 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:46.577618 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b205ac4-399e-4579-84ca-0780bf6d1616 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:46.578096 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b205ac4-399e-4579-84ca-0780bf6d1616 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:46.578527 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b205ac4-399e-4579-84ca-0780bf6d1616 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:46.579246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b205ac4-399e-4579-84ca-0780bf6d1616 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:46.579698 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b205ac4-399e-4579-84ca-0780bf6d1616 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:46.580146 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b205ac4-399e-4579-84ca-0780bf6d1616 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:46.594382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-3b205ac4-399e-4579-84ca-0780bf6d1616 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] HTTP exception thrown: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3b205ac4-399e-4579-84ca-0780bf6d1616 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Request method failure captured: Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 HTTP/1.1 Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZwiTTjIdFLzbpKGGpVA3DA-wQMC11XCY2BH6iqM7GBty3a3ccClw13LpIkL82s1_zUTcGUl6Fxcxen95MvsmbIMvoGt9q6XWYGOnL0LH9Um7BPa8yeMLK-bSKBoqaJjPxzTDkf7rQc9Wiq858Zw38xN0TvFDFaisonA92G3wQeNg1c Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 116fb506b7794c1fa9460b5a861de136 Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:16:46.596034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:16:46.597649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_116fb506b7794c1fa9460b5a861de136", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:16:46.597649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:16:46.597649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 116fb506b7794c1fa9460b5a861de136 Aug 30 05:16:46.597649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:16:46.597649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeTestJSON-1134370107-project Aug 30 05:16:46.597649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:16:46.597649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:16:46.597649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: a8f01d0042c84767899dc2b71bca4e12 Aug 30 05:16:46.597649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeTestJSON-1134370107-project Aug 30 05:16:46.597649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:16:46.597649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. Aug 30 05:16:46.597649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '2a54dc6f-8cee-4b66-9486-491841d01c27'} Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:16:46.598560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. Aug 30 05:16:46.599808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:16:46.600886 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3b205ac4-399e-4579-84ca-0780bf6d1616 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Returning 404 to user: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:16:46.600886 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3b205ac4-399e-4579-84ca-0780bf6d1616 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 404 len: 111 microversion: 2.1 time: 0.031315 Aug 30 05:16:46.600886 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 332/637] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:46 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:16:46.607193 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-99676342-8fae-4441-bb3a-fbeed43c80be tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '.version_select at 0x7f822ee8e160>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:46.625572 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-99676342-8fae-4441-bb3a-fbeed43c80be tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-158942566" status: 202 len: 0 microversion: 2.1 time: 0.022554 Aug 30 05:16:46.626475 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 306/638] 10.222.0.77 () {58 vars in 1218 bytes} [Tue Aug 30 05:16:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-158942566 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:16:47.249552 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-b3c1d245-9460-4954-bc92-7dc19c65c7a3 req-f671dd53-d2db-4ac2-948b-300189e8fab4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04bf81ed-0c85-4375-8e3b-eb18b7a48385", "tag": "1ef774e8-0aae-4b74-9370-1e268ea393a2"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:47.259680 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-b3c1d245-9460-4954-bc92-7dc19c65c7a3 req-f671dd53-d2db-4ac2-948b-300189e8fab4 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:47.260287 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-b3c1d245-9460-4954-bc92-7dc19c65c7a3 req-f671dd53-d2db-4ac2-948b-300189e8fab4 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:47.260792 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-b3c1d245-9460-4954-bc92-7dc19c65c7a3 req-f671dd53-d2db-4ac2-948b-300189e8fab4 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:47.274425 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-b3c1d245-9460-4954-bc92-7dc19c65c7a3 req-f671dd53-d2db-4ac2-948b-300189e8fab4 service nova] Creating event network-changed:1ef774e8-0aae-4b74-9370-1e268ea393a2 for instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 on hv-cinder-85391 Aug 30 05:16:47.279619 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8558d270-f3fb-449c-8811-3412c90c022a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Action: 'create', calling method: .version_select at 0x7f822ed498b0>, body: {"keypair": {"name": "tempest-keypair-606295863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/Lv35raXwTH+b9uX8/xOTqVoyCqJJQbGwJVYJ64Kf7dmzYKbu4rESTTlEiy8GlAroHAfhHRkhUF+ZkIqdG9LfRt7JX2szn9AU0hafwrzL8dNk2DkrwDYL3izwiS57F+A=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:47.280230 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-b3c1d245-9460-4954-bc92-7dc19c65c7a3 req-f671dd53-d2db-4ac2-948b-300189e8fab4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037423 Aug 30 05:16:47.284161 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 333/639] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:47.297073 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-8558d270-f3fb-449c-8811-3412c90c022a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Getting quotas for project 116fb506b7794c1fa9460b5a861de136. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:16:47.301216 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-8558d270-f3fb-449c-8811-3412c90c022a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Getting quotas for user a8f01d0042c84767899dc2b71bca4e12 and project 116fb506b7794c1fa9460b5a861de136. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:16:47.328499 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8558d270-f3fb-449c-8811-3412c90c022a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052985 Aug 30 05:16:47.330356 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 307/640] 10.222.0.77 () {60 vars in 1159 bytes} [Tue Aug 30 05:16:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:16:48.647831 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-100517981", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f19a3a63-4a1b-4d2c-ab3d-dff746819db6"}], "security_groups": [{"name": "tempest-securitygroup--1563400380"}], "key_name": "tempest-keypair-606295863", "user_data": "}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:48.750436 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] validate_networks() for [('f19a3a63-4a1b-4d2c-ab3d-dff746819db6', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:16:49.116112 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:16:49.116529 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:16:49.117023 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:16:49.117427 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:16:49.117832 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:16:49.126399 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:49.126891 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:49.127323 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:49.128042 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:49.128492 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:49.128914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:49.145517 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Getting quotas for project 116fb506b7794c1fa9460b5a861de136. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:16:49.149385 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Getting quotas for user a8f01d0042c84767899dc2b71bca4e12 and project 116fb506b7794c1fa9460b5a861de136. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:16:49.160918 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:16:49.163286 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:16:49.211001 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-46de8550-82bd-4e7f-b956-7bd9e9107852 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.568373 Aug 30 05:16:49.211648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 334/641] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:16:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:16:49.223371 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7d5a1531-b3c9-4c3e-83d4-770797cea97f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:49.224130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7d5a1531-b3c9-4c3e-83d4-770797cea97f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:49.290215 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7d5a1531-b3c9-4c3e-83d4-770797cea97f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:49.297052 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7d5a1531-b3c9-4c3e-83d4-770797cea97f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1236 microversion: 2.1 time: 0.078326 Aug 30 05:16:49.297827 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 308/642] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:49 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:50.317816 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b591edce-f750-45a7-bc8a-3ba79c978689 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:50.318578 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b591edce-f750-45a7-bc8a-3ba79c978689 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:50.327382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b591edce-f750-45a7-bc8a-3ba79c978689 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:50.328195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b591edce-f750-45a7-bc8a-3ba79c978689 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:50.328623 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b591edce-f750-45a7-bc8a-3ba79c978689 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:50.329321 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b591edce-f750-45a7-bc8a-3ba79c978689 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:50.329926 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b591edce-f750-45a7-bc8a-3ba79c978689 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:50.330347 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b591edce-f750-45a7-bc8a-3ba79c978689 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:50.397507 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b591edce-f750-45a7-bc8a-3ba79c978689 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:50.405176 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b591edce-f750-45a7-bc8a-3ba79c978689 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1296 microversion: 2.1 time: 0.091597 Aug 30 05:16:50.406286 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 335/643] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:50 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:51.428167 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-78bc96b7-4043-49fb-b908-df0d713be15f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:51.429023 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-78bc96b7-4043-49fb-b908-df0d713be15f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:51.436852 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78bc96b7-4043-49fb-b908-df0d713be15f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:51.437342 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78bc96b7-4043-49fb-b908-df0d713be15f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:51.437801 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78bc96b7-4043-49fb-b908-df0d713be15f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:51.438512 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78bc96b7-4043-49fb-b908-df0d713be15f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:51.438994 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78bc96b7-4043-49fb-b908-df0d713be15f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:51.439449 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78bc96b7-4043-49fb-b908-df0d713be15f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:51.887226 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-78bc96b7-4043-49fb-b908-df0d713be15f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:51.896259 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-78bc96b7-4043-49fb-b908-df0d713be15f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1362 microversion: 2.1 time: 0.473833 Aug 30 05:16:51.896972 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 309/644] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:51 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1362 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:51.909546 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-dcfbcac9-6bf5-4b90-a8c4-b6e76136531c req-9cfc70ce-31ed-42b7-80d9-c880b21a8cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4", "tag": "daced90f-36b0-406a-98c8-834fd146d1c8"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:51.922614 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-dcfbcac9-6bf5-4b90-a8c4-b6e76136531c req-9cfc70ce-31ed-42b7-80d9-c880b21a8cff service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:51.923302 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-dcfbcac9-6bf5-4b90-a8c4-b6e76136531c req-9cfc70ce-31ed-42b7-80d9-c880b21a8cff service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:51.923740 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-dcfbcac9-6bf5-4b90-a8c4-b6e76136531c req-9cfc70ce-31ed-42b7-80d9-c880b21a8cff service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:51.936723 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-dcfbcac9-6bf5-4b90-a8c4-b6e76136531c req-9cfc70ce-31ed-42b7-80d9-c880b21a8cff service nova] Creating event network-changed:daced90f-36b0-406a-98c8-834fd146d1c8 for instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 on hv-cinder-85391 Aug 30 05:16:51.941660 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-dcfbcac9-6bf5-4b90-a8c4-b6e76136531c req-9cfc70ce-31ed-42b7-80d9-c880b21a8cff service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035875 Aug 30 05:16:51.942512 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 336/645] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:52.917767 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e72d69ba-d892-49ca-ab37-0a3cbac3c65d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:52.918551 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e72d69ba-d892-49ca-ab37-0a3cbac3c65d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:52.925847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e72d69ba-d892-49ca-ab37-0a3cbac3c65d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:52.926338 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e72d69ba-d892-49ca-ab37-0a3cbac3c65d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:52.926777 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e72d69ba-d892-49ca-ab37-0a3cbac3c65d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:52.927534 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e72d69ba-d892-49ca-ab37-0a3cbac3c65d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:52.928014 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e72d69ba-d892-49ca-ab37-0a3cbac3c65d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:52.928437 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e72d69ba-d892-49ca-ab37-0a3cbac3c65d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:53.058483 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e72d69ba-d892-49ca-ab37-0a3cbac3c65d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:53.066482 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e72d69ba-d892-49ca-ab37-0a3cbac3c65d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1362 microversion: 2.1 time: 0.152810 Aug 30 05:16:53.067088 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 310/646] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:52 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:54.088123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7c192d85-331d-4d1a-bed2-d967c6393ca4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:54.088831 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7c192d85-331d-4d1a-bed2-d967c6393ca4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:54.095685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c192d85-331d-4d1a-bed2-d967c6393ca4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:54.096171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c192d85-331d-4d1a-bed2-d967c6393ca4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:54.096604 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c192d85-331d-4d1a-bed2-d967c6393ca4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:54.097297 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c192d85-331d-4d1a-bed2-d967c6393ca4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:54.097752 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c192d85-331d-4d1a-bed2-d967c6393ca4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:54.098173 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7c192d85-331d-4d1a-bed2-d967c6393ca4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:54.226384 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7c192d85-331d-4d1a-bed2-d967c6393ca4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:54.234321 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7c192d85-331d-4d1a-bed2-d967c6393ca4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1362 microversion: 2.1 time: 0.150371 Aug 30 05:16:54.234900 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 337/647] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:54 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:55.257150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d1a83a7c-7d94-453e-81f8-71dba9b348b5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:55.257877 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d1a83a7c-7d94-453e-81f8-71dba9b348b5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:55.264527 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1a83a7c-7d94-453e-81f8-71dba9b348b5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:55.265015 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1a83a7c-7d94-453e-81f8-71dba9b348b5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:55.265454 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1a83a7c-7d94-453e-81f8-71dba9b348b5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:55.266866 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1a83a7c-7d94-453e-81f8-71dba9b348b5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:55.266866 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1a83a7c-7d94-453e-81f8-71dba9b348b5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:55.267096 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d1a83a7c-7d94-453e-81f8-71dba9b348b5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:55.396622 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d1a83a7c-7d94-453e-81f8-71dba9b348b5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:55.404411 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d1a83a7c-7d94-453e-81f8-71dba9b348b5 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1362 microversion: 2.1 time: 0.151183 Aug 30 05:16:55.405072 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 311/648] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:55 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:56.424635 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-657aadd0-9bee-4624-b58d-c992e4818b0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:56.425248 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-657aadd0-9bee-4624-b58d-c992e4818b0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:56.431749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-657aadd0-9bee-4624-b58d-c992e4818b0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:56.432231 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-657aadd0-9bee-4624-b58d-c992e4818b0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:56.432667 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-657aadd0-9bee-4624-b58d-c992e4818b0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:56.433356 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-657aadd0-9bee-4624-b58d-c992e4818b0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:56.433808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-657aadd0-9bee-4624-b58d-c992e4818b0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:56.434230 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-657aadd0-9bee-4624-b58d-c992e4818b0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:56.559097 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-657aadd0-9bee-4624-b58d-c992e4818b0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:56.566562 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-657aadd0-9bee-4624-b58d-c992e4818b0e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1362 microversion: 2.1 time: 0.145813 Aug 30 05:16:56.567148 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 338/649] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:56 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:57.357579 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-7ddb151b-460a-43d1-99b8-25304909dbe0 req-affcb37c-f9ee-4dc2-a051-fdbf0fb69313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4", "name": "network-vif-plugged", "status": "completed", "tag": "daced90f-36b0-406a-98c8-834fd146d1c8"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:57.367670 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-7ddb151b-460a-43d1-99b8-25304909dbe0 req-affcb37c-f9ee-4dc2-a051-fdbf0fb69313 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:57.368244 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-7ddb151b-460a-43d1-99b8-25304909dbe0 req-affcb37c-f9ee-4dc2-a051-fdbf0fb69313 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:57.368738 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-7ddb151b-460a-43d1-99b8-25304909dbe0 req-affcb37c-f9ee-4dc2-a051-fdbf0fb69313 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:57.380630 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-7ddb151b-460a-43d1-99b8-25304909dbe0 req-affcb37c-f9ee-4dc2-a051-fdbf0fb69313 service nova] Creating event network-vif-plugged:daced90f-36b0-406a-98c8-834fd146d1c8 for instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 on hv-cinder-85391 Aug 30 05:16:57.385591 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-7ddb151b-460a-43d1-99b8-25304909dbe0 req-affcb37c-f9ee-4dc2-a051-fdbf0fb69313 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031762 Aug 30 05:16:57.386439 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 312/650] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:57.586609 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c33df024-f21a-4702-984e-7f331dbe8506 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:57.587288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c33df024-f21a-4702-984e-7f331dbe8506 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:57.593902 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c33df024-f21a-4702-984e-7f331dbe8506 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:57.594385 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c33df024-f21a-4702-984e-7f331dbe8506 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:57.594846 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c33df024-f21a-4702-984e-7f331dbe8506 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:57.595524 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c33df024-f21a-4702-984e-7f331dbe8506 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:57.595971 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c33df024-f21a-4702-984e-7f331dbe8506 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:57.596392 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c33df024-f21a-4702-984e-7f331dbe8506 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:57.725588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c33df024-f21a-4702-984e-7f331dbe8506 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:57.733711 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c33df024-f21a-4702-984e-7f331dbe8506 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1362 microversion: 2.1 time: 0.150924 Aug 30 05:16:57.734272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 339/651] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:57 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:58.754100 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-36467307-a4a5-40e2-8033-089d86a8a1a6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:58.754710 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-36467307-a4a5-40e2-8033-089d86a8a1a6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:58.761384 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36467307-a4a5-40e2-8033-089d86a8a1a6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:58.761865 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36467307-a4a5-40e2-8033-089d86a8a1a6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:58.762314 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36467307-a4a5-40e2-8033-089d86a8a1a6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:58.763012 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36467307-a4a5-40e2-8033-089d86a8a1a6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:58.764481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36467307-a4a5-40e2-8033-089d86a8a1a6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:58.765009 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-36467307-a4a5-40e2-8033-089d86a8a1a6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:58.899780 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-36467307-a4a5-40e2-8033-089d86a8a1a6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:58.908143 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-36467307-a4a5-40e2-8033-089d86a8a1a6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1362 microversion: 2.1 time: 0.158349 Aug 30 05:16:58.908701 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 313/652] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:58 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:59.929158 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-91dd7fa5-8987-4ce1-a8fc-fdeff8663acc tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:59.929773 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-91dd7fa5-8987-4ce1-a8fc-fdeff8663acc tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:59.932173 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:59.932831 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:59.938458 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91dd7fa5-8987-4ce1-a8fc-fdeff8663acc tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:59.938967 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91dd7fa5-8987-4ce1-a8fc-fdeff8663acc tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:59.939408 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91dd7fa5-8987-4ce1-a8fc-fdeff8663acc tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:59.940099 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91dd7fa5-8987-4ce1-a8fc-fdeff8663acc tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:59.940552 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91dd7fa5-8987-4ce1-a8fc-fdeff8663acc tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:59.940978 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-91dd7fa5-8987-4ce1-a8fc-fdeff8663acc tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:00.068531 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-91dd7fa5-8987-4ce1-a8fc-fdeff8663acc tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:00.076110 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-91dd7fa5-8987-4ce1-a8fc-fdeff8663acc tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1547 microversion: 2.1 time: 0.150804 Aug 30 05:17:00.076675 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 340/653] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:59 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:00.096851 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-69ea7283-aced-46eb-ac5b-2fbf99e98952 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:00.097394 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-69ea7283-aced-46eb-ac5b-2fbf99e98952 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:00.099281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=6 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:00.105153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69ea7283-aced-46eb-ac5b-2fbf99e98952 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:00.105650 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69ea7283-aced-46eb-ac5b-2fbf99e98952 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:00.106170 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69ea7283-aced-46eb-ac5b-2fbf99e98952 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:00.106957 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69ea7283-aced-46eb-ac5b-2fbf99e98952 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:00.107423 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69ea7283-aced-46eb-ac5b-2fbf99e98952 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:00.108351 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-69ea7283-aced-46eb-ac5b-2fbf99e98952 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:00.187391 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-69ea7283-aced-46eb-ac5b-2fbf99e98952 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094416 Aug 30 05:17:00.187983 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 314/654] 10.222.0.77 () {58 vars in 1275 bytes} [Tue Aug 30 05:17:00 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:01.092373 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-341a8049-bf03-40fb-9606-a2026500d03f req-eae17236-3958-4382-8085-f56834df8a29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4", "tag": "daced90f-36b0-406a-98c8-834fd146d1c8"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:01.101834 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-341a8049-bf03-40fb-9606-a2026500d03f req-eae17236-3958-4382-8085-f56834df8a29 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:01.102386 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-341a8049-bf03-40fb-9606-a2026500d03f req-eae17236-3958-4382-8085-f56834df8a29 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:01.102916 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-341a8049-bf03-40fb-9606-a2026500d03f req-eae17236-3958-4382-8085-f56834df8a29 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:01.116134 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-341a8049-bf03-40fb-9606-a2026500d03f req-eae17236-3958-4382-8085-f56834df8a29 service nova] Creating event network-changed:daced90f-36b0-406a-98c8-834fd146d1c8 for instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 on hv-cinder-85391 Aug 30 05:17:01.121393 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-341a8049-bf03-40fb-9606-a2026500d03f req-eae17236-3958-4382-8085-f56834df8a29 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032871 Aug 30 05:17:01.121986 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 341/655] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:20.371725 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:20.372523 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=45 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:20.377587 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-57c8de2d-0fe6-45b3-b495-a7aaf923cf9b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:20.378087 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-57c8de2d-0fe6-45b3-b495-a7aaf923cf9b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:20.385815 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57c8de2d-0fe6-45b3-b495-a7aaf923cf9b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:20.386303 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57c8de2d-0fe6-45b3-b495-a7aaf923cf9b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:20.386743 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57c8de2d-0fe6-45b3-b495-a7aaf923cf9b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:20.387467 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57c8de2d-0fe6-45b3-b495-a7aaf923cf9b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:20.387932 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57c8de2d-0fe6-45b3-b495-a7aaf923cf9b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:20.388363 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-57c8de2d-0fe6-45b3-b495-a7aaf923cf9b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:20.578578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-57c8de2d-0fe6-45b3-b495-a7aaf923cf9b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lazy-loading 'services' on Instance uuid 30714902-9da4-4ee8-8cb1-bd37f13ce234 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:17:20.648450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-57c8de2d-0fe6-45b3-b495-a7aaf923cf9b tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "DELETE /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/os-volume_attachments/281369de-4f1e-4820-9b90-f9d189f7623c" status: 202 len: 0 microversion: 2.1 time: 0.278085 Aug 30 05:17:20.649040 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 315/656] 10.222.0.77 () {58 vars in 1416 bytes} [Tue Aug 30 05:17:20 2022] DELETE /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/os-volume_attachments/281369de-4f1e-4820-9b90-f9d189f7623c => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:17:20.658463 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-86c9dbbc-f306-4b7d-982a-a4588007f9b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:20.660716 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-86c9dbbc-f306-4b7d-982a-a4588007f9b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:20.663591 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:20.664237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=52 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:20.669440 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86c9dbbc-f306-4b7d-982a-a4588007f9b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:20.670477 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86c9dbbc-f306-4b7d-982a-a4588007f9b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:20.671026 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86c9dbbc-f306-4b7d-982a-a4588007f9b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:20.671786 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86c9dbbc-f306-4b7d-982a-a4588007f9b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:20.672200 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86c9dbbc-f306-4b7d-982a-a4588007f9b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:20.672614 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86c9dbbc-f306-4b7d-982a-a4588007f9b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:20.703978 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-86c9dbbc-f306-4b7d-982a-a4588007f9b9 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050192 Aug 30 05:17:20.704520 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 342/657] 10.222.0.77 () {58 vars in 1302 bytes} [Tue Aug 30 05:17:20 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:17:21.718046 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9f479dcd-269b-4f84-b8be-810a87d07a3c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:21.720434 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9f479dcd-269b-4f84-b8be-810a87d07a3c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:21.726631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f479dcd-269b-4f84-b8be-810a87d07a3c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:21.727160 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f479dcd-269b-4f84-b8be-810a87d07a3c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:21.727606 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f479dcd-269b-4f84-b8be-810a87d07a3c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:21.728343 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f479dcd-269b-4f84-b8be-810a87d07a3c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:21.728801 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f479dcd-269b-4f84-b8be-810a87d07a3c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:21.729229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f479dcd-269b-4f84-b8be-810a87d07a3c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:21.757825 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9f479dcd-269b-4f84-b8be-810a87d07a3c tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045345 Aug 30 05:17:21.758381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 316/658] 10.222.0.77 () {58 vars in 1302 bytes} [Tue Aug 30 05:17:21 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 05:17:21.832518 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bbaa74a6-45c3-412c-81ae-b44059004cd3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:21.833013 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bbaa74a6-45c3-412c-81ae-b44059004cd3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:21.839258 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbaa74a6-45c3-412c-81ae-b44059004cd3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:21.839768 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbaa74a6-45c3-412c-81ae-b44059004cd3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:21.840205 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbaa74a6-45c3-412c-81ae-b44059004cd3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:21.840892 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbaa74a6-45c3-412c-81ae-b44059004cd3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:21.841345 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbaa74a6-45c3-412c-81ae-b44059004cd3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:21.842544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bbaa74a6-45c3-412c-81ae-b44059004cd3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:21.867007 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bbaa74a6-45c3-412c-81ae-b44059004cd3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:17:21.937347 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bbaa74a6-45c3-412c-81ae-b44059004cd3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "DELETE /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 204 len: 0 microversion: 2.1 time: 0.108345 Aug 30 05:17:21.938263 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 343/659] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:17:21 2022] DELETE /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:17:21.946317 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f78de5f6-d32a-4261-a57f-3833b4a2fb3e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:21.946969 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f78de5f6-d32a-4261-a57f-3833b4a2fb3e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:21.953321 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f78de5f6-d32a-4261-a57f-3833b4a2fb3e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:21.953804 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f78de5f6-d32a-4261-a57f-3833b4a2fb3e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:21.954241 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f78de5f6-d32a-4261-a57f-3833b4a2fb3e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:21.954958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f78de5f6-d32a-4261-a57f-3833b4a2fb3e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:21.955417 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f78de5f6-d32a-4261-a57f-3833b4a2fb3e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:21.955843 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f78de5f6-d32a-4261-a57f-3833b4a2fb3e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:22.082619 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f78de5f6-d32a-4261-a57f-3833b4a2fb3e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:22.090177 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f78de5f6-d32a-4261-a57f-3833b4a2fb3e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1691 microversion: 2.1 time: 0.147770 Aug 30 05:17:22.090749 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 317/660] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:21 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:17:23.113097 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4355e902-ab96-4c4c-ad37-40eed086e8fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:23.113806 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4355e902-ab96-4c4c-ad37-40eed086e8fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:23.120206 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4355e902-ab96-4c4c-ad37-40eed086e8fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:23.120693 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4355e902-ab96-4c4c-ad37-40eed086e8fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:23.121133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4355e902-ab96-4c4c-ad37-40eed086e8fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:23.121826 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4355e902-ab96-4c4c-ad37-40eed086e8fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:23.122285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4355e902-ab96-4c4c-ad37-40eed086e8fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:23.122710 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4355e902-ab96-4c4c-ad37-40eed086e8fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:23.348551 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4355e902-ab96-4c4c-ad37-40eed086e8fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:23.356308 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4355e902-ab96-4c4c-ad37-40eed086e8fb tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1691 microversion: 2.1 time: 0.247470 Aug 30 05:17:23.356874 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 344/661] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:23 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1691 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:23.595322 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-844567e2-b2c3-460d-9481-18b17a865b2a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:23.595906 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-844567e2-b2c3-460d-9481-18b17a865b2a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:23.601737 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-844567e2-b2c3-460d-9481-18b17a865b2a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:23.602224 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-844567e2-b2c3-460d-9481-18b17a865b2a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:23.602656 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-844567e2-b2c3-460d-9481-18b17a865b2a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:23.603370 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-844567e2-b2c3-460d-9481-18b17a865b2a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:23.603822 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-844567e2-b2c3-460d-9481-18b17a865b2a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:23.604252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-844567e2-b2c3-460d-9481-18b17a865b2a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:23.629602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-844567e2-b2c3-460d-9481-18b17a865b2a tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385/ips" status: 200 len: 150 microversion: 2.20 time: 0.090737 Aug 30 05:17:23.630164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 318/662] 10.222.0.77 () {60 vars in 1289 bytes} [Tue Aug 30 05:17:23 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385/ips => generated 150 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:17:24.377112 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-49cba80c-b943-469c-a21b-043005000add tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:24.377719 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-49cba80c-b943-469c-a21b-043005000add tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:24.384061 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-49cba80c-b943-469c-a21b-043005000add tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:24.384538 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-49cba80c-b943-469c-a21b-043005000add tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:24.384970 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-49cba80c-b943-469c-a21b-043005000add tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:24.385650 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-49cba80c-b943-469c-a21b-043005000add tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:24.386097 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-49cba80c-b943-469c-a21b-043005000add tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:24.386514 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-49cba80c-b943-469c-a21b-043005000add tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:24.515002 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-49cba80c-b943-469c-a21b-043005000add tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:24.522582 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-49cba80c-b943-469c-a21b-043005000add tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1691 microversion: 2.1 time: 0.149360 Aug 30 05:17:24.523170 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 345/663] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:24 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:25.543419 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a6528def-85b9-43fd-b642-129ec45b8352 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:25.543956 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a6528def-85b9-43fd-b642-129ec45b8352 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:25.550396 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6528def-85b9-43fd-b642-129ec45b8352 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:25.550915 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6528def-85b9-43fd-b642-129ec45b8352 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:25.551354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6528def-85b9-43fd-b642-129ec45b8352 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:25.552039 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6528def-85b9-43fd-b642-129ec45b8352 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:25.552491 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6528def-85b9-43fd-b642-129ec45b8352 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:25.552914 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a6528def-85b9-43fd-b642-129ec45b8352 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:25.740053 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a6528def-85b9-43fd-b642-129ec45b8352 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:25.747692 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a6528def-85b9-43fd-b642-129ec45b8352 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1691 microversion: 2.1 time: 0.208360 Aug 30 05:17:25.752843 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 319/664] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:25 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1691 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:25.901519 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-43408189-07c2-48bf-b303-9d4c8c11ec4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:25.902079 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-43408189-07c2-48bf-b303-9d4c8c11ec4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:25.909155 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43408189-07c2-48bf-b303-9d4c8c11ec4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:25.909639 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43408189-07c2-48bf-b303-9d4c8c11ec4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:25.910079 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43408189-07c2-48bf-b303-9d4c8c11ec4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:25.910771 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43408189-07c2-48bf-b303-9d4c8c11ec4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:25.911251 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43408189-07c2-48bf-b303-9d4c8c11ec4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:25.911677 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-43408189-07c2-48bf-b303-9d4c8c11ec4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:25.934241 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-43408189-07c2-48bf-b303-9d4c8c11ec4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lazy-loading 'flavor' on Instance uuid 04bf81ed-0c85-4375-8e3b-eb18b7a48385 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:17:26.115716 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-43408189-07c2-48bf-b303-9d4c8c11ec4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "POST /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385/action" status: 202 len: 0 microversion: 2.20 time: 0.217764 Aug 30 05:17:26.117416 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 346/665] 10.222.0.77 () {62 vars in 1319 bytes} [Tue Aug 30 05:17:25 2022] POST /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:17:26.126158 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f6211444-3d9e-42c2-9c00-026f45afe291 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:26.127002 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f6211444-3d9e-42c2-9c00-026f45afe291 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:26.133139 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6211444-3d9e-42c2-9c00-026f45afe291 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:26.133496 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6211444-3d9e-42c2-9c00-026f45afe291 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:26.133931 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6211444-3d9e-42c2-9c00-026f45afe291 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:26.134633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6211444-3d9e-42c2-9c00-026f45afe291 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:26.135103 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6211444-3d9e-42c2-9c00-026f45afe291 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:26.135547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f6211444-3d9e-42c2-9c00-026f45afe291 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:26.351703 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f6211444-3d9e-42c2-9c00-026f45afe291 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:26.360254 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f6211444-3d9e-42c2-9c00-026f45afe291 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:26.361701 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f6211444-3d9e-42c2-9c00-026f45afe291 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:26.362887 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f6211444-3d9e-42c2-9c00-026f45afe291 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1721 microversion: 2.20 time: 0.241128 Aug 30 05:17:26.363449 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 320/666] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:26 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:26.564385 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-30da779a-ab7c-43f4-9c08-54caa0640679 req-faf465b5-7e72-4386-8beb-10a3cbdf3191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30714902-9da4-4ee8-8cb1-bd37f13ce234", "name": "network-vif-deleted", "tag": "361c8508-8cc9-4e2d-95e0-07af85e45dfa"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:26.574718 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-30da779a-ab7c-43f4-9c08-54caa0640679 req-faf465b5-7e72-4386-8beb-10a3cbdf3191 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:26.575331 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-30da779a-ab7c-43f4-9c08-54caa0640679 req-faf465b5-7e72-4386-8beb-10a3cbdf3191 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:26.575759 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-30da779a-ab7c-43f4-9c08-54caa0640679 req-faf465b5-7e72-4386-8beb-10a3cbdf3191 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:26.586774 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-30da779a-ab7c-43f4-9c08-54caa0640679 req-faf465b5-7e72-4386-8beb-10a3cbdf3191 service nova] Creating event network-vif-deleted:361c8508-8cc9-4e2d-95e0-07af85e45dfa for instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 on hv-cinder-85391 Aug 30 05:17:26.591940 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-30da779a-ab7c-43f4-9c08-54caa0640679 req-faf465b5-7e72-4386-8beb-10a3cbdf3191 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031857 Aug 30 05:17:26.595555 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 347/667] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:26.768998 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4771ff65-e61d-4674-bb79-9a1dc5d460c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:26.769649 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4771ff65-e61d-4674-bb79-9a1dc5d460c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:26.777132 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4771ff65-e61d-4674-bb79-9a1dc5d460c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:26.777633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4771ff65-e61d-4674-bb79-9a1dc5d460c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:26.778076 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4771ff65-e61d-4674-bb79-9a1dc5d460c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:26.779752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4771ff65-e61d-4674-bb79-9a1dc5d460c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:26.780390 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4771ff65-e61d-4674-bb79-9a1dc5d460c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:26.780990 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4771ff65-e61d-4674-bb79-9a1dc5d460c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:26.813826 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4771ff65-e61d-4674-bb79-9a1dc5d460c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:26.814318 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4771ff65-e61d-4674-bb79-9a1dc5d460c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:26.814753 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4771ff65-e61d-4674-bb79-9a1dc5d460c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:26.815395 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-4771ff65-e61d-4674-bb79-9a1dc5d460c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lazy-loading 'fault' on Instance uuid 30714902-9da4-4ee8-8cb1-bd37f13ce234 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:17:26.861459 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4771ff65-e61d-4674-bb79-9a1dc5d460c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:26.869455 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4771ff65-e61d-4674-bb79-9a1dc5d460c3 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 200 len: 1335 microversion: 2.1 time: 0.104712 Aug 30 05:17:26.870122 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 321/668] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:26 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 1335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:27.386490 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cd79aa48-7ea8-46f3-8afe-60dc9a6074d4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:27.387222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cd79aa48-7ea8-46f3-8afe-60dc9a6074d4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:27.393870 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd79aa48-7ea8-46f3-8afe-60dc9a6074d4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:27.394358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd79aa48-7ea8-46f3-8afe-60dc9a6074d4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:27.394801 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd79aa48-7ea8-46f3-8afe-60dc9a6074d4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:27.395518 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd79aa48-7ea8-46f3-8afe-60dc9a6074d4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:27.395975 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd79aa48-7ea8-46f3-8afe-60dc9a6074d4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:27.396405 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd79aa48-7ea8-46f3-8afe-60dc9a6074d4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:27.534921 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cd79aa48-7ea8-46f3-8afe-60dc9a6074d4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:27.543077 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cd79aa48-7ea8-46f3-8afe-60dc9a6074d4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:27.544523 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cd79aa48-7ea8-46f3-8afe-60dc9a6074d4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:27.545730 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cd79aa48-7ea8-46f3-8afe-60dc9a6074d4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1721 microversion: 2.20 time: 0.163993 Aug 30 05:17:27.546293 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 348/669] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:27 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:27.890461 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-23ba57d8-8fb8-437d-807a-09d4fc3e25b2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:27.891116 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-23ba57d8-8fb8-437d-807a-09d4fc3e25b2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 30714902-9da4-4ee8-8cb1-bd37f13ce234] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:27.897630 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23ba57d8-8fb8-437d-807a-09d4fc3e25b2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:27.898123 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23ba57d8-8fb8-437d-807a-09d4fc3e25b2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:27.898593 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23ba57d8-8fb8-437d-807a-09d4fc3e25b2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:27.899319 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23ba57d8-8fb8-437d-807a-09d4fc3e25b2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:27.899782 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23ba57d8-8fb8-437d-807a-09d4fc3e25b2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:27.900215 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-23ba57d8-8fb8-437d-807a-09d4fc3e25b2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:27.913429 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-23ba57d8-8fb8-437d-807a-09d4fc3e25b2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] HTTP exception thrown: Instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 could not be found. Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-23ba57d8-8fb8-437d-807a-09d4fc3e25b2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Request method failure captured: Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 HTTP/1.1 Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZwmh_DDwRU_BEVybRcQ6moSB8pHRQiYw6M2nPThYf10X2ijKHRbdaToX7zYPI-l6N6xyuqYMKqMjKZm748svv5LhMk4_YqUXJlUw5ALU6ysD7iSFrCxa6aOOZC9I2TnhN2vvAfWp7CNt0MAA0G45_k3r-EKMDgIQuxnO7y2pB0I1EQ Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: d2ce224c162c414c9be681b76801969c Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802004164 Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:17:27.915120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:17:27.916718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/d2ce224c162c414c9be681b76801969c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/d2ce224c162c414c9be681b76801969c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/d2ce224c162c414c9be681b76801969c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_d2ce224c162c414c9be681b76801969c", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:17:27.916718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802004164 Aug 30 05:17:27.916718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: d2ce224c162c414c9be681b76801969c Aug 30 05:17:27.916718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802004164 Aug 30 05:17:27.916718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-ServerRescueNegativeTestJSON-1802004164-project Aug 30 05:17:27.916718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:17:27.916718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:17:27.916718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: 31cc6aa564be4c569e6fa89813cb9329 Aug 30 05:17:27.916718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802004164-project Aug 30 05:17:27.916718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:17:27.916718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 could not be found. Aug 30 05:17:27.916718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': '30714902-9da4-4ee8-8cb1-bd37f13ce234'} Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 could not be found. Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:17:27.917638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 could not be found. Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 could not be found. Aug 30 05:17:27.919162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:17:27.921073 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-23ba57d8-8fb8-437d-807a-09d4fc3e25b2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Returning 404 to user: Instance 30714902-9da4-4ee8-8cb1-bd37f13ce234 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:17:27.921073 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-23ba57d8-8fb8-437d-807a-09d4fc3e25b2 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234" status: 404 len: 111 microversion: 2.1 time: 0.029989 Aug 30 05:17:27.921073 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 322/670] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:27 2022] GET /compute/v2.1/servers/30714902-9da4-4ee8-8cb1-bd37f13ce234 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:17:27.925748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-84046cd9-4a89-4870-99b3-0e30e34721a5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '.version_select at 0x7f822ed971f0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:27.958026 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-84046cd9-4a89-4870-99b3-0e30e34721a5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1208478708" status: 202 len: 0 microversion: 2.1 time: 0.036050 Aug 30 05:17:27.958597 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 349/671] 10.222.0.77 () {58 vars in 1221 bytes} [Tue Aug 30 05:17:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1208478708 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:17:28.569033 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-27d09385-0f45-4caa-8a5b-979da5d01928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:28.569644 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-27d09385-0f45-4caa-8a5b-979da5d01928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:28.575443 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27d09385-0f45-4caa-8a5b-979da5d01928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:28.576420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27d09385-0f45-4caa-8a5b-979da5d01928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:28.576855 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27d09385-0f45-4caa-8a5b-979da5d01928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:28.577545 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27d09385-0f45-4caa-8a5b-979da5d01928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:28.577997 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27d09385-0f45-4caa-8a5b-979da5d01928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:28.578414 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-27d09385-0f45-4caa-8a5b-979da5d01928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:28.756196 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-27d09385-0f45-4caa-8a5b-979da5d01928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:28.764730 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-27d09385-0f45-4caa-8a5b-979da5d01928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:28.766162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-27d09385-0f45-4caa-8a5b-979da5d01928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:28.767431 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-27d09385-0f45-4caa-8a5b-979da5d01928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1721 microversion: 2.20 time: 0.202280 Aug 30 05:17:28.768120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 323/672] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:28 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:29.790554 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-737b245e-fa1c-4fb9-8c14-18401f78afb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:29.791114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-737b245e-fa1c-4fb9-8c14-18401f78afb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:29.799012 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-737b245e-fa1c-4fb9-8c14-18401f78afb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:29.799498 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-737b245e-fa1c-4fb9-8c14-18401f78afb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:29.799934 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-737b245e-fa1c-4fb9-8c14-18401f78afb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:29.800622 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-737b245e-fa1c-4fb9-8c14-18401f78afb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:29.801074 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-737b245e-fa1c-4fb9-8c14-18401f78afb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:29.801500 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-737b245e-fa1c-4fb9-8c14-18401f78afb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:29.925449 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-737b245e-fa1c-4fb9-8c14-18401f78afb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:29.933498 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-737b245e-fa1c-4fb9-8c14-18401f78afb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:29.934975 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-737b245e-fa1c-4fb9-8c14-18401f78afb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:29.936145 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-737b245e-fa1c-4fb9-8c14-18401f78afb7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1721 microversion: 2.20 time: 0.149558 Aug 30 05:17:29.936701 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 350/673] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:29 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:30.958669 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1f3ccae4-9fb7-4f1a-857b-793384359bb1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:30.959324 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1f3ccae4-9fb7-4f1a-857b-793384359bb1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:30.965769 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f3ccae4-9fb7-4f1a-857b-793384359bb1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:30.966254 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f3ccae4-9fb7-4f1a-857b-793384359bb1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:30.966963 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f3ccae4-9fb7-4f1a-857b-793384359bb1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:30.967656 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f3ccae4-9fb7-4f1a-857b-793384359bb1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:30.968109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f3ccae4-9fb7-4f1a-857b-793384359bb1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:30.968535 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f3ccae4-9fb7-4f1a-857b-793384359bb1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:31.097824 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1f3ccae4-9fb7-4f1a-857b-793384359bb1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:31.106012 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1f3ccae4-9fb7-4f1a-857b-793384359bb1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:31.107990 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1f3ccae4-9fb7-4f1a-857b-793384359bb1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:31.109165 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1f3ccae4-9fb7-4f1a-857b-793384359bb1 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1721 microversion: 2.20 time: 0.154387 Aug 30 05:17:31.109726 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 324/674] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:30 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:31.130538 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-97460062-d1f3-4db3-9541-f3eef30e4618 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:31.131066 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-97460062-d1f3-4db3-9541-f3eef30e4618 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:31.137272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97460062-d1f3-4db3-9541-f3eef30e4618 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:31.137747 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97460062-d1f3-4db3-9541-f3eef30e4618 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:31.138181 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97460062-d1f3-4db3-9541-f3eef30e4618 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:31.138884 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97460062-d1f3-4db3-9541-f3eef30e4618 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:31.139337 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97460062-d1f3-4db3-9541-f3eef30e4618 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:31.139755 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97460062-d1f3-4db3-9541-f3eef30e4618 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:31.164203 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-97460062-d1f3-4db3-9541-f3eef30e4618 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:17:31.236290 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-97460062-d1f3-4db3-9541-f3eef30e4618 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "DELETE /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 204 len: 0 microversion: 2.1 time: 0.109221 Aug 30 05:17:31.236768 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 351/675] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:17:31 2022] DELETE /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:17:31.244628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1023076e-b72b-4b7f-bb2c-5598295862bf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:31.245549 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1023076e-b72b-4b7f-bb2c-5598295862bf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:31.252018 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1023076e-b72b-4b7f-bb2c-5598295862bf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:31.252549 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1023076e-b72b-4b7f-bb2c-5598295862bf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:31.252922 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1023076e-b72b-4b7f-bb2c-5598295862bf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:31.253626 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1023076e-b72b-4b7f-bb2c-5598295862bf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:31.254084 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1023076e-b72b-4b7f-bb2c-5598295862bf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:31.254511 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1023076e-b72b-4b7f-bb2c-5598295862bf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:31.384200 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1023076e-b72b-4b7f-bb2c-5598295862bf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:31.391819 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1023076e-b72b-4b7f-bb2c-5598295862bf tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1508 microversion: 2.1 time: 0.150992 Aug 30 05:17:31.392395 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 325/676] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:31 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:32.132870 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-782dc4f6-9a1c-480d-9de0-ec07ab72e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:32.133570 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-782dc4f6-9a1c-480d-9de0-ec07ab72e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:32.140568 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-782dc4f6-9a1c-480d-9de0-ec07ab72e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:32.141048 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-782dc4f6-9a1c-480d-9de0-ec07ab72e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:32.141482 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-782dc4f6-9a1c-480d-9de0-ec07ab72e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:32.142166 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-782dc4f6-9a1c-480d-9de0-ec07ab72e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:32.142618 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-782dc4f6-9a1c-480d-9de0-ec07ab72e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:32.143070 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-782dc4f6-9a1c-480d-9de0-ec07ab72e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:32.271684 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-782dc4f6-9a1c-480d-9de0-ec07ab72e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:32.279676 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-782dc4f6-9a1c-480d-9de0-ec07ab72e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:32.281114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-782dc4f6-9a1c-480d-9de0-ec07ab72e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:32.282267 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-782dc4f6-9a1c-480d-9de0-ec07ab72e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1721 microversion: 2.20 time: 0.153686 Aug 30 05:17:32.282842 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 352/677] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:32 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:32.413328 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-93cbdf54-dcea-4353-b2bc-13a53c72c89a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:32.413944 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-93cbdf54-dcea-4353-b2bc-13a53c72c89a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:32.421003 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93cbdf54-dcea-4353-b2bc-13a53c72c89a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:32.421483 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93cbdf54-dcea-4353-b2bc-13a53c72c89a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:32.421912 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93cbdf54-dcea-4353-b2bc-13a53c72c89a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:32.422599 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93cbdf54-dcea-4353-b2bc-13a53c72c89a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:32.423083 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93cbdf54-dcea-4353-b2bc-13a53c72c89a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:32.423510 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-93cbdf54-dcea-4353-b2bc-13a53c72c89a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:32.550983 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-93cbdf54-dcea-4353-b2bc-13a53c72c89a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:32.558457 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-93cbdf54-dcea-4353-b2bc-13a53c72c89a tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1508 microversion: 2.1 time: 0.148932 Aug 30 05:17:32.559055 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 326/678] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:32 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:33.305710 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d57b21ec-1fd6-448b-a067-92676cb5cb92 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:33.306320 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d57b21ec-1fd6-448b-a067-92676cb5cb92 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:33.312734 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d57b21ec-1fd6-448b-a067-92676cb5cb92 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:33.313211 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d57b21ec-1fd6-448b-a067-92676cb5cb92 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:33.313644 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d57b21ec-1fd6-448b-a067-92676cb5cb92 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:33.314327 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d57b21ec-1fd6-448b-a067-92676cb5cb92 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:33.314779 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d57b21ec-1fd6-448b-a067-92676cb5cb92 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:33.315238 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d57b21ec-1fd6-448b-a067-92676cb5cb92 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:33.439182 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d57b21ec-1fd6-448b-a067-92676cb5cb92 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:33.447178 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d57b21ec-1fd6-448b-a067-92676cb5cb92 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:33.448639 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d57b21ec-1fd6-448b-a067-92676cb5cb92 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:33.449784 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d57b21ec-1fd6-448b-a067-92676cb5cb92 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1721 microversion: 2.20 time: 0.147971 Aug 30 05:17:33.450337 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 353/679] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:33 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:33.580361 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b79f2a67-e010-43fe-8ea9-c557ca5673c5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:33.580969 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b79f2a67-e010-43fe-8ea9-c557ca5673c5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:33.587414 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b79f2a67-e010-43fe-8ea9-c557ca5673c5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:33.588034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b79f2a67-e010-43fe-8ea9-c557ca5673c5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:33.588502 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b79f2a67-e010-43fe-8ea9-c557ca5673c5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:33.589187 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b79f2a67-e010-43fe-8ea9-c557ca5673c5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:33.589635 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b79f2a67-e010-43fe-8ea9-c557ca5673c5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:33.590056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b79f2a67-e010-43fe-8ea9-c557ca5673c5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:33.811368 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b79f2a67-e010-43fe-8ea9-c557ca5673c5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:33.818789 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b79f2a67-e010-43fe-8ea9-c557ca5673c5 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 200 len: 1508 microversion: 2.1 time: 0.242866 Aug 30 05:17:33.819466 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 327/680] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:33 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 1508 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:34.200104 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-f1b3f905-7504-41a8-b78d-1a75de9c7a42 req-a7a923f2-3ec7-4533-b8de-b8a8d63b77ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43143409-91ae-49e1-a4d3-688ea54d1d0b", "name": "network-vif-deleted", "tag": "04285150-7904-4555-9230-fcb76ec2800d"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:34.209737 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-f1b3f905-7504-41a8-b78d-1a75de9c7a42 req-a7a923f2-3ec7-4533-b8de-b8a8d63b77ca service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:34.210216 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-f1b3f905-7504-41a8-b78d-1a75de9c7a42 req-a7a923f2-3ec7-4533-b8de-b8a8d63b77ca service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:34.210640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-f1b3f905-7504-41a8-b78d-1a75de9c7a42 req-a7a923f2-3ec7-4533-b8de-b8a8d63b77ca service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:34.222595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-f1b3f905-7504-41a8-b78d-1a75de9c7a42 req-a7a923f2-3ec7-4533-b8de-b8a8d63b77ca service nova] Creating event network-vif-deleted:04285150-7904-4555-9230-fcb76ec2800d for instance 43143409-91ae-49e1-a4d3-688ea54d1d0b on hv-cinder-85391 Aug 30 05:17:34.227169 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-f1b3f905-7504-41a8-b78d-1a75de9c7a42 req-a7a923f2-3ec7-4533-b8de-b8a8d63b77ca service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103128 Aug 30 05:17:34.227760 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 354/681] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:34.473365 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c5e61324-c7b1-4043-afae-90938b444063 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:34.474081 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c5e61324-c7b1-4043-afae-90938b444063 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:34.480530 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5e61324-c7b1-4043-afae-90938b444063 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:34.481088 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5e61324-c7b1-4043-afae-90938b444063 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:34.481524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5e61324-c7b1-4043-afae-90938b444063 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:34.482770 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5e61324-c7b1-4043-afae-90938b444063 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:34.483454 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5e61324-c7b1-4043-afae-90938b444063 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:34.483876 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c5e61324-c7b1-4043-afae-90938b444063 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:34.614543 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c5e61324-c7b1-4043-afae-90938b444063 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:34.622677 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c5e61324-c7b1-4043-afae-90938b444063 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:34.624155 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c5e61324-c7b1-4043-afae-90938b444063 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:34.625319 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c5e61324-c7b1-4043-afae-90938b444063 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1721 microversion: 2.20 time: 0.155861 Aug 30 05:17:34.625871 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 328/682] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:34 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:34.839903 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2bf4f80b-19c3-428d-86e8-17962f1459aa tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:34.840682 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2bf4f80b-19c3-428d-86e8-17962f1459aa tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: 43143409-91ae-49e1-a4d3-688ea54d1d0b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:34.848007 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bf4f80b-19c3-428d-86e8-17962f1459aa tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:34.848498 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bf4f80b-19c3-428d-86e8-17962f1459aa tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:34.848943 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bf4f80b-19c3-428d-86e8-17962f1459aa tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:34.849639 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bf4f80b-19c3-428d-86e8-17962f1459aa tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:34.850102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bf4f80b-19c3-428d-86e8-17962f1459aa tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:34.850531 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2bf4f80b-19c3-428d-86e8-17962f1459aa tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:34.863801 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-2bf4f80b-19c3-428d-86e8-17962f1459aa tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] HTTP exception thrown: Instance 43143409-91ae-49e1-a4d3-688ea54d1d0b could not be found. Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2bf4f80b-19c3-428d-86e8-17962f1459aa tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Request method failure captured: Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b HTTP/1.1 Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZwmh_DDwRU_BEVybRcQ6moSB8pHRQiYw6M2nPThYf10X2ijKHRbdaToX7zYPI-l6N6xyuqYMKqMjKZm748svv5LhMk4_YqUXJlUw5ALU6ysD7iSFrCxa6aOOZC9I2TnhN2vvAfWp7CNt0MAA0G45_k3r-EKMDgIQuxnO7y2pB0I1EQ Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: d2ce224c162c414c9be681b76801969c Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802004164 Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:17:34.865403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:17:34.866995 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/d2ce224c162c414c9be681b76801969c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/d2ce224c162c414c9be681b76801969c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/d2ce224c162c414c9be681b76801969c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_d2ce224c162c414c9be681b76801969c", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:17:34.866995 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802004164 Aug 30 05:17:34.866995 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: d2ce224c162c414c9be681b76801969c Aug 30 05:17:34.866995 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802004164 Aug 30 05:17:34.866995 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-ServerRescueNegativeTestJSON-1802004164-project Aug 30 05:17:34.866995 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:17:34.866995 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:17:34.866995 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: 31cc6aa564be4c569e6fa89813cb9329 Aug 30 05:17:34.866995 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802004164-project Aug 30 05:17:34.866995 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:17:34.866995 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 43143409-91ae-49e1-a4d3-688ea54d1d0b could not be found. Aug 30 05:17:34.866995 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '43143409-91ae-49e1-a4d3-688ea54d1d0b'} Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43143409-91ae-49e1-a4d3-688ea54d1d0b could not be found. Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:17:34.867815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43143409-91ae-49e1-a4d3-688ea54d1d0b could not be found. Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43143409-91ae-49e1-a4d3-688ea54d1d0b could not be found. Aug 30 05:17:34.869187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:17:34.870453 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2bf4f80b-19c3-428d-86e8-17962f1459aa tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Returning 404 to user: Instance 43143409-91ae-49e1-a4d3-688ea54d1d0b could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:17:34.870453 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2bf4f80b-19c3-428d-86e8-17962f1459aa tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b" status: 404 len: 111 microversion: 2.1 time: 0.031627 Aug 30 05:17:34.870453 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 355/683] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:34 2022] GET /compute/v2.1/servers/43143409-91ae-49e1-a4d3-688ea54d1d0b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:17:34.875350 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8cac0a39-b9ed-4dc6-924c-08a64c14964e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:34.875862 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8cac0a39-b9ed-4dc6-924c-08a64c14964e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:34.881656 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cac0a39-b9ed-4dc6-924c-08a64c14964e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:34.882140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cac0a39-b9ed-4dc6-924c-08a64c14964e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:34.882573 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cac0a39-b9ed-4dc6-924c-08a64c14964e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:34.883291 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cac0a39-b9ed-4dc6-924c-08a64c14964e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:34.883750 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cac0a39-b9ed-4dc6-924c-08a64c14964e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:34.884182 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8cac0a39-b9ed-4dc6-924c-08a64c14964e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:34.910295 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8cac0a39-b9ed-4dc6-924c-08a64c14964e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:17:34.958796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:34.986208 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8cac0a39-b9ed-4dc6-924c-08a64c14964e tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 204 len: 0 microversion: 2.1 time: 0.114370 Aug 30 05:17:34.987131 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 329/684] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:17:34 2022] DELETE /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 05:17:34.996911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c5e57578-61cf-47b0-bbfb-fce31f968b42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:34.998025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c5e57578-61cf-47b0-bbfb-fce31f968b42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:35.004328 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c5e57578-61cf-47b0-bbfb-fce31f968b42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:35.004925 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c5e57578-61cf-47b0-bbfb-fce31f968b42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:35.005397 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c5e57578-61cf-47b0-bbfb-fce31f968b42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:35.006288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c5e57578-61cf-47b0-bbfb-fce31f968b42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:35.006982 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c5e57578-61cf-47b0-bbfb-fce31f968b42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:35.007565 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c5e57578-61cf-47b0-bbfb-fce31f968b42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:35.012493 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:35.149063 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c5e57578-61cf-47b0-bbfb-fce31f968b42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:35.156683 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c5e57578-61cf-47b0-bbfb-fce31f968b42 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.165140 Aug 30 05:17:35.157251 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 356/685] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:34 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:35.648752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eaca7af2-b118-41d0-9034-50848634059c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:35.649459 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eaca7af2-b118-41d0-9034-50848634059c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:35.656255 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaca7af2-b118-41d0-9034-50848634059c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:35.656740 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaca7af2-b118-41d0-9034-50848634059c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:35.657178 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaca7af2-b118-41d0-9034-50848634059c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:35.657863 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaca7af2-b118-41d0-9034-50848634059c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:35.658321 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaca7af2-b118-41d0-9034-50848634059c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:35.658746 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eaca7af2-b118-41d0-9034-50848634059c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:35.784543 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eaca7af2-b118-41d0-9034-50848634059c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:35.792497 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eaca7af2-b118-41d0-9034-50848634059c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:35.793940 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eaca7af2-b118-41d0-9034-50848634059c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:35.795694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eaca7af2-b118-41d0-9034-50848634059c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1721 microversion: 2.20 time: 0.151230 Aug 30 05:17:35.796255 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 330/686] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:35 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:36.177123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-24990d73-7ccf-478b-8374-f9e7386971e7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:36.177834 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-24990d73-7ccf-478b-8374-f9e7386971e7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:36.184245 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24990d73-7ccf-478b-8374-f9e7386971e7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:36.184718 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24990d73-7ccf-478b-8374-f9e7386971e7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:36.185151 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24990d73-7ccf-478b-8374-f9e7386971e7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:36.185827 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24990d73-7ccf-478b-8374-f9e7386971e7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:36.186275 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24990d73-7ccf-478b-8374-f9e7386971e7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:36.186691 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-24990d73-7ccf-478b-8374-f9e7386971e7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:36.311092 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-24990d73-7ccf-478b-8374-f9e7386971e7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:36.318802 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-24990d73-7ccf-478b-8374-f9e7386971e7 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.145466 Aug 30 05:17:36.319405 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 357/687] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:36 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:36.817496 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d4030ff3-1563-4a07-870c-1ac70e4fa697 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:36.818104 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d4030ff3-1563-4a07-870c-1ac70e4fa697 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:36.824550 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4030ff3-1563-4a07-870c-1ac70e4fa697 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:36.825032 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4030ff3-1563-4a07-870c-1ac70e4fa697 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:36.825469 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4030ff3-1563-4a07-870c-1ac70e4fa697 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:36.826155 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4030ff3-1563-4a07-870c-1ac70e4fa697 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:36.826610 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4030ff3-1563-4a07-870c-1ac70e4fa697 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:36.827071 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d4030ff3-1563-4a07-870c-1ac70e4fa697 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:36.951248 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d4030ff3-1563-4a07-870c-1ac70e4fa697 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:36.959426 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d4030ff3-1563-4a07-870c-1ac70e4fa697 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:36.960861 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d4030ff3-1563-4a07-870c-1ac70e4fa697 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:36.962002 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d4030ff3-1563-4a07-870c-1ac70e4fa697 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1721 microversion: 2.20 time: 0.148449 Aug 30 05:17:36.962555 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 331/688] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:36 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:37.241283 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cd616f35-93ec-4cf0-9808-218aea7c3873 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:37.241762 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cd616f35-93ec-4cf0-9808-218aea7c3873 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:37.247612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd616f35-93ec-4cf0-9808-218aea7c3873 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:37.248095 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd616f35-93ec-4cf0-9808-218aea7c3873 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:37.248529 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd616f35-93ec-4cf0-9808-218aea7c3873 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:37.249216 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd616f35-93ec-4cf0-9808-218aea7c3873 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:37.249667 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd616f35-93ec-4cf0-9808-218aea7c3873 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:37.250113 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cd616f35-93ec-4cf0-9808-218aea7c3873 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:37.273523 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cd616f35-93ec-4cf0-9808-218aea7c3873 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/ips" status: 200 len: 144 microversion: 2.1 time: 0.084064 Aug 30 05:17:37.274077 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 358/689] 10.222.0.77 () {58 vars in 1248 bytes} [Tue Aug 30 05:17:37 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/ips => generated 144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:37.339794 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8977c690-9d54-4b84-8c13-153485ba7403 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:37.340406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8977c690-9d54-4b84-8c13-153485ba7403 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:37.347219 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8977c690-9d54-4b84-8c13-153485ba7403 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:37.347702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8977c690-9d54-4b84-8c13-153485ba7403 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:37.348196 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8977c690-9d54-4b84-8c13-153485ba7403 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:37.348802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8977c690-9d54-4b84-8c13-153485ba7403 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:37.349253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8977c690-9d54-4b84-8c13-153485ba7403 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:37.349681 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8977c690-9d54-4b84-8c13-153485ba7403 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:37.497102 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8977c690-9d54-4b84-8c13-153485ba7403 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:37.506162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8977c690-9d54-4b84-8c13-153485ba7403 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1522 microversion: 2.1 time: 0.170080 Aug 30 05:17:37.510849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 332/690] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:37 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:37.984781 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c12eaff2-8f2a-44ad-b321-6c2fe8023628 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:37.985487 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c12eaff2-8f2a-44ad-b321-6c2fe8023628 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:37.991361 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c12eaff2-8f2a-44ad-b321-6c2fe8023628 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:37.991840 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c12eaff2-8f2a-44ad-b321-6c2fe8023628 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:37.992273 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c12eaff2-8f2a-44ad-b321-6c2fe8023628 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:37.992952 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c12eaff2-8f2a-44ad-b321-6c2fe8023628 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:37.993404 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c12eaff2-8f2a-44ad-b321-6c2fe8023628 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:37.993903 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c12eaff2-8f2a-44ad-b321-6c2fe8023628 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:38.125333 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c12eaff2-8f2a-44ad-b321-6c2fe8023628 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:38.133507 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c12eaff2-8f2a-44ad-b321-6c2fe8023628 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:38.134976 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c12eaff2-8f2a-44ad-b321-6c2fe8023628 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:38.136142 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c12eaff2-8f2a-44ad-b321-6c2fe8023628 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1742 microversion: 2.20 time: 0.155214 Aug 30 05:17:38.136701 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 359/691] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:37 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:38.319224 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-b1fb7904-8716-44f9-919a-d348f97c5c2a req-55d706b1-fe68-41c4-9fea-c596bd11747d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ec17dd-c9e2-4802-86c7-f985a04be891", "name": "network-vif-deleted", "tag": "3231ee58-a276-4f6a-a338-703b3e38ed84"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:38.329499 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-b1fb7904-8716-44f9-919a-d348f97c5c2a req-55d706b1-fe68-41c4-9fea-c596bd11747d service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:38.329987 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-b1fb7904-8716-44f9-919a-d348f97c5c2a req-55d706b1-fe68-41c4-9fea-c596bd11747d service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:38.330416 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-b1fb7904-8716-44f9-919a-d348f97c5c2a req-55d706b1-fe68-41c4-9fea-c596bd11747d service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:38.342714 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-b1fb7904-8716-44f9-919a-d348f97c5c2a req-55d706b1-fe68-41c4-9fea-c596bd11747d service nova] Creating event network-vif-deleted:3231ee58-a276-4f6a-a338-703b3e38ed84 for instance e0ec17dd-c9e2-4802-86c7-f985a04be891 on hv-cinder-85391 Aug 30 05:17:38.348773 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-b1fb7904-8716-44f9-919a-d348f97c5c2a req-55d706b1-fe68-41c4-9fea-c596bd11747d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033240 Aug 30 05:17:38.349364 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 333/692] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:38.527080 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c9e3ddad-d891-4dec-9cf9-1d9115418711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:38.527689 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c9e3ddad-d891-4dec-9cf9-1d9115418711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:38.534022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9e3ddad-d891-4dec-9cf9-1d9115418711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:38.534461 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9e3ddad-d891-4dec-9cf9-1d9115418711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:38.534924 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9e3ddad-d891-4dec-9cf9-1d9115418711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:38.535617 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9e3ddad-d891-4dec-9cf9-1d9115418711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:38.536069 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9e3ddad-d891-4dec-9cf9-1d9115418711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:38.536488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9e3ddad-d891-4dec-9cf9-1d9115418711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:38.568394 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9e3ddad-d891-4dec-9cf9-1d9115418711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:38.568876 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9e3ddad-d891-4dec-9cf9-1d9115418711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:38.569305 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c9e3ddad-d891-4dec-9cf9-1d9115418711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:38.569748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-c9e3ddad-d891-4dec-9cf9-1d9115418711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lazy-loading 'fault' on Instance uuid e0ec17dd-c9e2-4802-86c7-f985a04be891 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:17:38.617799 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c9e3ddad-d891-4dec-9cf9-1d9115418711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31cc6aa564be4c569e6fa89813cb9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ce224c162c414c9be681b76801969c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:38.625280 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b775dc71-b709-4326-83a1-bd0bd6c7c516 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2e32480-472c-4d64-a6d7-82efa349ecb5"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:38.626711 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c9e3ddad-d891-4dec-9cf9-1d9115418711 tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 200 len: 1312 microversion: 2.1 time: 0.103383 Aug 30 05:17:38.627333 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 360/693] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:38 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:38.628282 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b775dc71-b709-4326-83a1-bd0bd6c7c516 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:38.634598 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b775dc71-b709-4326-83a1-bd0bd6c7c516 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:38.635156 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b775dc71-b709-4326-83a1-bd0bd6c7c516 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:38.635599 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b775dc71-b709-4326-83a1-bd0bd6c7c516 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:38.636310 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b775dc71-b709-4326-83a1-bd0bd6c7c516 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:38.636772 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b775dc71-b709-4326-83a1-bd0bd6c7c516 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:38.637202 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b775dc71-b709-4326-83a1-bd0bd6c7c516 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:39.019645 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b775dc71-b709-4326-83a1-bd0bd6c7c516 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "POST /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399706 Aug 30 05:17:39.020321 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 334/694] 10.222.0.77 () {60 vars in 1323 bytes} [Tue Aug 30 05:17:38 2022] POST /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:17:39.160276 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4336310a-c72c-4eae-8657-c5f4398a59cf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:39.160912 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4336310a-c72c-4eae-8657-c5f4398a59cf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:39.166905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4336310a-c72c-4eae-8657-c5f4398a59cf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:39.167395 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4336310a-c72c-4eae-8657-c5f4398a59cf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:39.167832 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4336310a-c72c-4eae-8657-c5f4398a59cf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:39.168532 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4336310a-c72c-4eae-8657-c5f4398a59cf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:39.168987 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4336310a-c72c-4eae-8657-c5f4398a59cf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:39.169410 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4336310a-c72c-4eae-8657-c5f4398a59cf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:39.296868 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4336310a-c72c-4eae-8657-c5f4398a59cf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:39.305385 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4336310a-c72c-4eae-8657-c5f4398a59cf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:39.306839 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4336310a-c72c-4eae-8657-c5f4398a59cf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:39.307999 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4336310a-c72c-4eae-8657-c5f4398a59cf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1742 microversion: 2.20 time: 0.151671 Aug 30 05:17:39.308556 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 361/695] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:39 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:39.648318 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1d42f55b-928f-46f3-a30d-75922566091f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:39.649267 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1d42f55b-928f-46f3-a30d-75922566091f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] [instance: e0ec17dd-c9e2-4802-86c7-f985a04be891] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:39.655341 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d42f55b-928f-46f3-a30d-75922566091f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:39.655824 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d42f55b-928f-46f3-a30d-75922566091f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:39.656256 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d42f55b-928f-46f3-a30d-75922566091f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:39.656951 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d42f55b-928f-46f3-a30d-75922566091f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:39.657405 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d42f55b-928f-46f3-a30d-75922566091f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:39.657825 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d42f55b-928f-46f3-a30d-75922566091f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:39.671015 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-1d42f55b-928f-46f3-a30d-75922566091f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] HTTP exception thrown: Instance e0ec17dd-c9e2-4802-86c7-f985a04be891 could not be found. Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1d42f55b-928f-46f3-a30d-75922566091f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Request method failure captured: Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 HTTP/1.1 Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZwmh_DDwRU_BEVybRcQ6moSB8pHRQiYw6M2nPThYf10X2ijKHRbdaToX7zYPI-l6N6xyuqYMKqMjKZm748svv5LhMk4_YqUXJlUw5ALU6ysD7iSFrCxa6aOOZC9I2TnhN2vvAfWp7CNt0MAA0G45_k3r-EKMDgIQuxnO7y2pB0I1EQ Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: d2ce224c162c414c9be681b76801969c Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1802004164 Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:17:39.672638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:17:39.674192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/d2ce224c162c414c9be681b76801969c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/d2ce224c162c414c9be681b76801969c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/d2ce224c162c414c9be681b76801969c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_d2ce224c162c414c9be681b76801969c", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:17:39.674192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1802004164 Aug 30 05:17:39.674192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: d2ce224c162c414c9be681b76801969c Aug 30 05:17:39.674192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1802004164 Aug 30 05:17:39.674192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-ServerRescueNegativeTestJSON-1802004164-project Aug 30 05:17:39.674192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:17:39.674192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:17:39.674192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: 31cc6aa564be4c569e6fa89813cb9329 Aug 30 05:17:39.674192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1802004164-project Aug 30 05:17:39.674192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:17:39.674192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance e0ec17dd-c9e2-4802-86c7-f985a04be891 could not be found. Aug 30 05:17:39.674192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': 'e0ec17dd-c9e2-4802-86c7-f985a04be891'} Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ec17dd-c9e2-4802-86c7-f985a04be891 could not be found. Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:17:39.675154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ec17dd-c9e2-4802-86c7-f985a04be891 could not be found. Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ec17dd-c9e2-4802-86c7-f985a04be891 could not be found. Aug 30 05:17:39.676664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:17:39.678094 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1d42f55b-928f-46f3-a30d-75922566091f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] Returning 404 to user: Instance e0ec17dd-c9e2-4802-86c7-f985a04be891 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:17:39.678094 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1d42f55b-928f-46f3-a30d-75922566091f tempest-ServerRescueNegativeTestJSON-1802004164 tempest-ServerRescueNegativeTestJSON-1802004164-project] 10.222.0.77 "GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891" status: 404 len: 111 microversion: 2.1 time: 0.030405 Aug 30 05:17:39.678094 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 335/696] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:39 2022] GET /compute/v2.1/servers/e0ec17dd-c9e2-4802-86c7-f985a04be891 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:17:40.331896 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-04a9f936-5a90-4ea1-a149-fa737903e64b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:40.333183 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-04a9f936-5a90-4ea1-a149-fa737903e64b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:40.339958 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a9f936-5a90-4ea1-a149-fa737903e64b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:40.340651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a9f936-5a90-4ea1-a149-fa737903e64b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:40.341871 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a9f936-5a90-4ea1-a149-fa737903e64b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:40.342765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a9f936-5a90-4ea1-a149-fa737903e64b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:40.343439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a9f936-5a90-4ea1-a149-fa737903e64b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:40.344060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04a9f936-5a90-4ea1-a149-fa737903e64b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:40.475490 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-04a9f936-5a90-4ea1-a149-fa737903e64b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:40.484884 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-04a9f936-5a90-4ea1-a149-fa737903e64b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:40.486340 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-04a9f936-5a90-4ea1-a149-fa737903e64b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:40.487544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-04a9f936-5a90-4ea1-a149-fa737903e64b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1737 microversion: 2.20 time: 0.160749 Aug 30 05:17:40.488097 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 362/697] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:40 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:41.510811 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9697e2f9-869c-4f7d-b94e-6b9e61ee5483 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:41.512230 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9697e2f9-869c-4f7d-b94e-6b9e61ee5483 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:41.524888 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9697e2f9-869c-4f7d-b94e-6b9e61ee5483 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:41.526530 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9697e2f9-869c-4f7d-b94e-6b9e61ee5483 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:41.528158 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9697e2f9-869c-4f7d-b94e-6b9e61ee5483 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:41.529094 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9697e2f9-869c-4f7d-b94e-6b9e61ee5483 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:41.532465 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9697e2f9-869c-4f7d-b94e-6b9e61ee5483 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:41.533115 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9697e2f9-869c-4f7d-b94e-6b9e61ee5483 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:41.698273 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-2c24f909-5d9c-49af-aa7e-c8be37641634 req-7e099e73-61c7-4355-8ebd-41621e494b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bf81ed-0c85-4375-8e3b-eb18b7a48385", "name": "network-vif-plugged", "status": "completed", "tag": "1ef774e8-0aae-4b74-9370-1e268ea393a2"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:41.717616 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2c24f909-5d9c-49af-aa7e-c8be37641634 req-7e099e73-61c7-4355-8ebd-41621e494b09 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:41.718094 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2c24f909-5d9c-49af-aa7e-c8be37641634 req-7e099e73-61c7-4355-8ebd-41621e494b09 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:41.718520 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-2c24f909-5d9c-49af-aa7e-c8be37641634 req-7e099e73-61c7-4355-8ebd-41621e494b09 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:41.748362 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-2c24f909-5d9c-49af-aa7e-c8be37641634 req-7e099e73-61c7-4355-8ebd-41621e494b09 service nova] Creating event network-vif-plugged:1ef774e8-0aae-4b74-9370-1e268ea393a2 for instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 on hv-cinder-85391 Aug 30 05:17:41.765762 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-2c24f909-5d9c-49af-aa7e-c8be37641634 req-7e099e73-61c7-4355-8ebd-41621e494b09 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069801 Aug 30 05:17:41.769444 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 363/698] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:41.806129 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9697e2f9-869c-4f7d-b94e-6b9e61ee5483 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:41.829648 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9697e2f9-869c-4f7d-b94e-6b9e61ee5483 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:41.831304 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9697e2f9-869c-4f7d-b94e-6b9e61ee5483 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:41.832646 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9697e2f9-869c-4f7d-b94e-6b9e61ee5483 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1737 microversion: 2.20 time: 0.325683 Aug 30 05:17:41.833812 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 336/699] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:41 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1737 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:42.861205 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2ff3e205-3da5-41fa-bd2b-3f6fea2b2a4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:42.863412 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2ff3e205-3da5-41fa-bd2b-3f6fea2b2a4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:42.888079 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ff3e205-3da5-41fa-bd2b-3f6fea2b2a4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:42.888919 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ff3e205-3da5-41fa-bd2b-3f6fea2b2a4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:42.889816 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ff3e205-3da5-41fa-bd2b-3f6fea2b2a4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:42.893167 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ff3e205-3da5-41fa-bd2b-3f6fea2b2a4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:42.893647 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ff3e205-3da5-41fa-bd2b-3f6fea2b2a4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:42.895416 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2ff3e205-3da5-41fa-bd2b-3f6fea2b2a4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:43.192332 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2ff3e205-3da5-41fa-bd2b-3f6fea2b2a4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:43.201075 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2ff3e205-3da5-41fa-bd2b-3f6fea2b2a4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:43.207635 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2ff3e205-3da5-41fa-bd2b-3f6fea2b2a4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:43.209119 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2ff3e205-3da5-41fa-bd2b-3f6fea2b2a4b tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1737 microversion: 2.20 time: 0.357247 Aug 30 05:17:43.223458 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 364/700] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:42 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1737 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:44.234560 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9eb21d89-3292-4951-88dc-528d8505aaf4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:44.236082 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9eb21d89-3292-4951-88dc-528d8505aaf4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:44.244123 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9eb21d89-3292-4951-88dc-528d8505aaf4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:44.244696 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9eb21d89-3292-4951-88dc-528d8505aaf4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:44.245194 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9eb21d89-3292-4951-88dc-528d8505aaf4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:44.245970 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9eb21d89-3292-4951-88dc-528d8505aaf4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:44.246588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9eb21d89-3292-4951-88dc-528d8505aaf4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:44.247039 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9eb21d89-3292-4951-88dc-528d8505aaf4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:44.400351 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9eb21d89-3292-4951-88dc-528d8505aaf4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:44.427051 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9eb21d89-3292-4951-88dc-528d8505aaf4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:44.431727 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9eb21d89-3292-4951-88dc-528d8505aaf4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:44.432931 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9eb21d89-3292-4951-88dc-528d8505aaf4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1737 microversion: 2.20 time: 0.203289 Aug 30 05:17:44.447357 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 337/701] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:44 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:45.458036 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ddc58a7b-7220-4c07-84b0-fb068a5528bf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:45.459242 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ddc58a7b-7220-4c07-84b0-fb068a5528bf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:45.473258 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddc58a7b-7220-4c07-84b0-fb068a5528bf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:45.473969 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddc58a7b-7220-4c07-84b0-fb068a5528bf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:45.474564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddc58a7b-7220-4c07-84b0-fb068a5528bf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:45.475977 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddc58a7b-7220-4c07-84b0-fb068a5528bf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:45.476591 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddc58a7b-7220-4c07-84b0-fb068a5528bf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:45.477561 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ddc58a7b-7220-4c07-84b0-fb068a5528bf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:45.698488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ddc58a7b-7220-4c07-84b0-fb068a5528bf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:45.711937 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ddc58a7b-7220-4c07-84b0-fb068a5528bf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:45.713723 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ddc58a7b-7220-4c07-84b0-fb068a5528bf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:45.715313 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ddc58a7b-7220-4c07-84b0-fb068a5528bf tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1737 microversion: 2.20 time: 0.261981 Aug 30 05:17:45.731535 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 365/702] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:45 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1737 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:46.255662 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-16221ae5-b3a8-4b87-b882-3b3cf06b094e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:46.256666 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-16221ae5-b3a8-4b87-b882-3b3cf06b094e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:46.267750 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16221ae5-b3a8-4b87-b882-3b3cf06b094e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:46.268547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16221ae5-b3a8-4b87-b882-3b3cf06b094e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:46.271218 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16221ae5-b3a8-4b87-b882-3b3cf06b094e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:46.272127 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16221ae5-b3a8-4b87-b882-3b3cf06b094e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:46.272739 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16221ae5-b3a8-4b87-b882-3b3cf06b094e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:46.276109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-16221ae5-b3a8-4b87-b882-3b3cf06b094e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:46.330791 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-16221ae5-b3a8-4b87-b882-3b3cf06b094e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:17:46.464395 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-16221ae5-b3a8-4b87-b882-3b3cf06b094e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 204 len: 0 microversion: 2.1 time: 0.212097 Aug 30 05:17:46.472423 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 338/703] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:17:46 2022] DELETE /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:17:46.475459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5351ad93-d2b0-408d-93d0-62a074e2bc21 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:46.476120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5351ad93-d2b0-408d-93d0-62a074e2bc21 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:46.487606 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5351ad93-d2b0-408d-93d0-62a074e2bc21 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:46.489821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5351ad93-d2b0-408d-93d0-62a074e2bc21 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:46.494298 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5351ad93-d2b0-408d-93d0-62a074e2bc21 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:46.496337 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5351ad93-d2b0-408d-93d0-62a074e2bc21 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:46.499539 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5351ad93-d2b0-408d-93d0-62a074e2bc21 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:46.499972 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5351ad93-d2b0-408d-93d0-62a074e2bc21 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:46.743054 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9054c27c-1150-4462-bbf9-18e870670ec7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:46.743054 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9054c27c-1150-4462-bbf9-18e870670ec7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:46.746153 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5351ad93-d2b0-408d-93d0-62a074e2bc21 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:46.751014 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9054c27c-1150-4462-bbf9-18e870670ec7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:46.751537 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9054c27c-1150-4462-bbf9-18e870670ec7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:46.753671 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9054c27c-1150-4462-bbf9-18e870670ec7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:46.754435 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9054c27c-1150-4462-bbf9-18e870670ec7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:46.755809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5351ad93-d2b0-408d-93d0-62a074e2bc21 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1576 microversion: 2.1 time: 0.285589 Aug 30 05:17:46.758492 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9054c27c-1150-4462-bbf9-18e870670ec7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:46.759054 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 366/704] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:46 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1576 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:17:46.759619 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9054c27c-1150-4462-bbf9-18e870670ec7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:46.769030 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-85b9e1e7-149a-4ebd-a10c-d741de25a70d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:46.776048 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-85b9e1e7-149a-4ebd-a10c-d741de25a70d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:46.785794 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-85b9e1e7-149a-4ebd-a10c-d741de25a70d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:46.786659 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-85b9e1e7-149a-4ebd-a10c-d741de25a70d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:46.787232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-85b9e1e7-149a-4ebd-a10c-d741de25a70d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:46.788134 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-85b9e1e7-149a-4ebd-a10c-d741de25a70d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:46.789467 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-85b9e1e7-149a-4ebd-a10c-d741de25a70d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:46.789467 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-85b9e1e7-149a-4ebd-a10c-d741de25a70d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:46.861014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-85b9e1e7-149a-4ebd-a10c-d741de25a70d tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096077 Aug 30 05:17:46.861992 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 367/705] 10.222.0.77 () {58 vars in 1302 bytes} [Tue Aug 30 05:17:46 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:46.874938 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ede8e03d-f6e2-435c-b654-ef85b2ede4a3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:46.878573 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ede8e03d-f6e2-435c-b654-ef85b2ede4a3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:46.886689 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede8e03d-f6e2-435c-b654-ef85b2ede4a3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:46.887520 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede8e03d-f6e2-435c-b654-ef85b2ede4a3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:46.888657 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede8e03d-f6e2-435c-b654-ef85b2ede4a3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:46.890615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede8e03d-f6e2-435c-b654-ef85b2ede4a3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:46.891501 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede8e03d-f6e2-435c-b654-ef85b2ede4a3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:46.892233 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ede8e03d-f6e2-435c-b654-ef85b2ede4a3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:46.954910 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ede8e03d-f6e2-435c-b654-ef85b2ede4a3 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments/e2e32480-472c-4d64-a6d7-82efa349ecb5" status: 200 len: 194 microversion: 2.1 time: 0.084450 Aug 30 05:17:46.974435 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 368/706] 10.222.0.77 () {58 vars in 1413 bytes} [Tue Aug 30 05:17:46 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments/e2e32480-472c-4d64-a6d7-82efa349ecb5 => generated 194 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:47.003327 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9054c27c-1150-4462-bbf9-18e870670ec7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:47.011692 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9054c27c-1150-4462-bbf9-18e870670ec7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:47.013780 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9054c27c-1150-4462-bbf9-18e870670ec7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:47.015040 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9054c27c-1150-4462-bbf9-18e870670ec7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1737 microversion: 2.20 time: 0.280647 Aug 30 05:17:47.032087 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 339/707] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:46 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1737 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:17:47.783185 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6975486a-24e1-4a4f-82d9-40b2341a7f48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:47.784589 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6975486a-24e1-4a4f-82d9-40b2341a7f48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:47.806643 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6975486a-24e1-4a4f-82d9-40b2341a7f48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:47.807396 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6975486a-24e1-4a4f-82d9-40b2341a7f48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:47.807870 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6975486a-24e1-4a4f-82d9-40b2341a7f48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:47.808652 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6975486a-24e1-4a4f-82d9-40b2341a7f48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:47.809139 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6975486a-24e1-4a4f-82d9-40b2341a7f48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:47.809581 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6975486a-24e1-4a4f-82d9-40b2341a7f48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:48.041340 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2581ecd4-b6d3-45da-a37a-ede1d82c68a9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:48.042533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2581ecd4-b6d3-45da-a37a-ede1d82c68a9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:48.063165 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2581ecd4-b6d3-45da-a37a-ede1d82c68a9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:48.063989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2581ecd4-b6d3-45da-a37a-ede1d82c68a9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:48.064688 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2581ecd4-b6d3-45da-a37a-ede1d82c68a9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:48.065577 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2581ecd4-b6d3-45da-a37a-ede1d82c68a9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:48.066370 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2581ecd4-b6d3-45da-a37a-ede1d82c68a9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:48.067018 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2581ecd4-b6d3-45da-a37a-ede1d82c68a9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:48.120301 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6975486a-24e1-4a4f-82d9-40b2341a7f48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:48.129923 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6975486a-24e1-4a4f-82d9-40b2341a7f48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1576 microversion: 2.1 time: 0.352024 Aug 30 05:17:48.132106 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 369/708] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:47 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1576 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:48.579763 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-97670d74-0924-4f20-9b63-cbf66b6942d8 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80ccef28-bd46-46d3-b559-1001bb95aa95"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:48.584091 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-97670d74-0924-4f20-9b63-cbf66b6942d8 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:48.592612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97670d74-0924-4f20-9b63-cbf66b6942d8 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:48.593129 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97670d74-0924-4f20-9b63-cbf66b6942d8 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:48.593574 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97670d74-0924-4f20-9b63-cbf66b6942d8 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:48.594361 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97670d74-0924-4f20-9b63-cbf66b6942d8 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:48.594803 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97670d74-0924-4f20-9b63-cbf66b6942d8 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:48.595334 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-97670d74-0924-4f20-9b63-cbf66b6942d8 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:48.791180 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2581ecd4-b6d3-45da-a37a-ede1d82c68a9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:48.818412 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2581ecd4-b6d3-45da-a37a-ede1d82c68a9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:48.822446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2581ecd4-b6d3-45da-a37a-ede1d82c68a9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:48.823703 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2581ecd4-b6d3-45da-a37a-ede1d82c68a9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1737 microversion: 2.20 time: 0.787034 Aug 30 05:17:48.826546 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 340/709] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:48 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1737 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:49.093969 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-97670d74-0924-4f20-9b63-cbf66b6942d8 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "POST /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.520869 Aug 30 05:17:49.096189 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 370/710] 10.222.0.77 () {60 vars in 1323 bytes} [Tue Aug 30 05:17:48 2022] POST /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments => generated 194 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:17:49.155846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b1fc0be8-cb7f-4772-acbe-6a09ec861095 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:49.156663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b1fc0be8-cb7f-4772-acbe-6a09ec861095 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:49.162792 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1fc0be8-cb7f-4772-acbe-6a09ec861095 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:49.168768 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1fc0be8-cb7f-4772-acbe-6a09ec861095 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:49.169274 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1fc0be8-cb7f-4772-acbe-6a09ec861095 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:49.170029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1fc0be8-cb7f-4772-acbe-6a09ec861095 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:49.170494 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1fc0be8-cb7f-4772-acbe-6a09ec861095 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:49.173385 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b1fc0be8-cb7f-4772-acbe-6a09ec861095 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:49.535373 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b1fc0be8-cb7f-4772-acbe-6a09ec861095 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:49.553444 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b1fc0be8-cb7f-4772-acbe-6a09ec861095 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1576 microversion: 2.1 time: 0.402169 Aug 30 05:17:49.567607 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 341/711] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:49 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1576 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:49.850631 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f51db349-1866-4f57-9598-1ad6929cb2cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:49.851401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f51db349-1866-4f57-9598-1ad6929cb2cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:49.860524 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f51db349-1866-4f57-9598-1ad6929cb2cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:49.861018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f51db349-1866-4f57-9598-1ad6929cb2cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:49.861455 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f51db349-1866-4f57-9598-1ad6929cb2cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:49.862162 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f51db349-1866-4f57-9598-1ad6929cb2cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:49.862620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f51db349-1866-4f57-9598-1ad6929cb2cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:49.863078 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f51db349-1866-4f57-9598-1ad6929cb2cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:50.143561 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f51db349-1866-4f57-9598-1ad6929cb2cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:50.154371 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f51db349-1866-4f57-9598-1ad6929cb2cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:50.160572 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f51db349-1866-4f57-9598-1ad6929cb2cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:50.164195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f51db349-1866-4f57-9598-1ad6929cb2cb tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1737 microversion: 2.20 time: 0.318297 Aug 30 05:17:50.166630 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 371/712] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:49 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1737 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:50.558550 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-c03b767a-e3f3-4242-a9b1-afc59bf626d1 req-31a7d822-5ffe-4b44-b70d-aa44fc69ab27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6", "name": "network-vif-deleted", "tag": "f08307cf-f44e-403c-bd63-0b7921eca530"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:50.566847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:50.575699 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b2a07150-97b3-48e0-97cc-dab1bdc81228 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:50.576404 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b2a07150-97b3-48e0-97cc-dab1bdc81228 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:50.589782 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c03b767a-e3f3-4242-a9b1-afc59bf626d1 req-31a7d822-5ffe-4b44-b70d-aa44fc69ab27 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:50.590278 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c03b767a-e3f3-4242-a9b1-afc59bf626d1 req-31a7d822-5ffe-4b44-b70d-aa44fc69ab27 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:50.590734 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c03b767a-e3f3-4242-a9b1-afc59bf626d1 req-31a7d822-5ffe-4b44-b70d-aa44fc69ab27 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:50.591733 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2a07150-97b3-48e0-97cc-dab1bdc81228 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:50.592243 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2a07150-97b3-48e0-97cc-dab1bdc81228 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:50.592729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2a07150-97b3-48e0-97cc-dab1bdc81228 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:50.598102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2a07150-97b3-48e0-97cc-dab1bdc81228 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:50.598750 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2a07150-97b3-48e0-97cc-dab1bdc81228 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:50.604484 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2a07150-97b3-48e0-97cc-dab1bdc81228 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:50.610984 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:50.644087 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-c03b767a-e3f3-4242-a9b1-afc59bf626d1 req-31a7d822-5ffe-4b44-b70d-aa44fc69ab27 service nova] Creating event network-vif-deleted:f08307cf-f44e-403c-bd63-0b7921eca530 for instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 on hv-cinder-85391 Aug 30 05:17:50.657825 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-c03b767a-e3f3-4242-a9b1-afc59bf626d1 req-31a7d822-5ffe-4b44-b70d-aa44fc69ab27 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103919 Aug 30 05:17:50.658712 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 342/713] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:50.861337 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b2a07150-97b3-48e0-97cc-dab1bdc81228 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:50.869710 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b2a07150-97b3-48e0-97cc-dab1bdc81228 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 200 len: 1225 microversion: 2.1 time: 0.298252 Aug 30 05:17:50.870306 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 372/714] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:50 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 1225 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:17:51.191192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-496e38c3-3bb2-46ac-b000-7025e49e6384 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:51.191908 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-496e38c3-3bb2-46ac-b000-7025e49e6384 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:51.215921 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-496e38c3-3bb2-46ac-b000-7025e49e6384 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:51.221704 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-496e38c3-3bb2-46ac-b000-7025e49e6384 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:51.223239 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-496e38c3-3bb2-46ac-b000-7025e49e6384 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:51.226430 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-496e38c3-3bb2-46ac-b000-7025e49e6384 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:51.229063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-496e38c3-3bb2-46ac-b000-7025e49e6384 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:51.229737 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-496e38c3-3bb2-46ac-b000-7025e49e6384 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:51.577607 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-496e38c3-3bb2-46ac-b000-7025e49e6384 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:51.629421 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-496e38c3-3bb2-46ac-b000-7025e49e6384 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:51.630883 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-496e38c3-3bb2-46ac-b000-7025e49e6384 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:51.648364 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-496e38c3-3bb2-46ac-b000-7025e49e6384 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1737 microversion: 2.20 time: 0.461733 Aug 30 05:17:51.649637 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 343/715] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:51 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1737 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:51.895012 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-631efbd2-fa43-4c47-82ca-049c9d51834a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:51.895629 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-631efbd2-fa43-4c47-82ca-049c9d51834a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:51.909744 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:51.916871 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-631efbd2-fa43-4c47-82ca-049c9d51834a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:51.917486 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-631efbd2-fa43-4c47-82ca-049c9d51834a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:51.918044 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-631efbd2-fa43-4c47-82ca-049c9d51834a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:51.920036 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-631efbd2-fa43-4c47-82ca-049c9d51834a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:51.920507 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-631efbd2-fa43-4c47-82ca-049c9d51834a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:51.920971 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-631efbd2-fa43-4c47-82ca-049c9d51834a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:51.945972 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-631efbd2-fa43-4c47-82ca-049c9d51834a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] HTTP exception thrown: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-631efbd2-fa43-4c47-82ca-049c9d51834a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Request method failure captured: Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 HTTP/1.1 Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZzF-LSzrjkuGaxRc0MLonAu55I9uAT9VebYV8aNWg0pE7DQoGlGuMEv4e49aGHio6uqGTTYNtBBoHVA4WKyN4AYzzrBv8RP-GfYF2CDv4uyfDme1msVJKQv_0JdqT6Fk_aFes8BF-oCX0JHEQEZrNKhuHgCcXqfHTFyHcqaBKPuWmY Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 97e3452b02294219ae56cd23eb2aa0ce Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-TestVolumeBootPattern-1802884946 Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:17:51.948728 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:17:51.950403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/97e3452b02294219ae56cd23eb2aa0ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/97e3452b02294219ae56cd23eb2aa0ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/97e3452b02294219ae56cd23eb2aa0ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_97e3452b02294219ae56cd23eb2aa0ce", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:17:51.950403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-TestVolumeBootPattern-1802884946 Aug 30 05:17:51.950403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 97e3452b02294219ae56cd23eb2aa0ce Aug 30 05:17:51.950403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802884946 Aug 30 05:17:51.950403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-TestVolumeBootPattern-1802884946-project Aug 30 05:17:51.950403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:17:51.950403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:17:51.950403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: 9256fd43e5124fb68d4e5453584d1e8d Aug 30 05:17:51.950403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-TestVolumeBootPattern-1802884946-project Aug 30 05:17:51.950403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:17:51.950403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. Aug 30 05:17:51.950403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': 'e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6'} Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:17:51.951459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. Aug 30 05:17:51.952914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:17:51.954349 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-631efbd2-fa43-4c47-82ca-049c9d51834a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Returning 404 to user: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:17:51.954349 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-631efbd2-fa43-4c47-82ca-049c9d51834a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 404 len: 111 microversion: 2.1 time: 0.064512 Aug 30 05:17:51.960407 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 373/716] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:51 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:17:52.162850 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8c3349b5-1489-4ce1-a8d8-2f5df975a4ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Action: 'create', calling method: .version_select at 0x7f822ed01af0>, body: {"keypair": {"name": "tempest-keypair-79741342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSQ/sTUHLAFdQaSAGbxhN1e0j344/79Fz5rp2dmE2kf/RsC+cXb6C38BGeAoGzJBC0uZS/bh7Tr7NwUXblTRbksp8uQD+iuGs18zPIG7Qlq4p75lyrtXIr5DULrg0LVfQ=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:52.169715 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-619928970", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1477137281", "security_groups": [{"name": "tempest-secgroup-smoke-21014458"}], "block_device_mapping_v2": [{"uuid": "da47d600-fea3-48cd-8d22-92e7893b5941", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "15c65eeb-dfe2-43bb-9925-99f6c334ef61"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:52.190926 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-8c3349b5-1489-4ce1-a8d8-2f5df975a4ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Getting quotas for project bebd859c24cd4ed3b7e32a82de820b8a. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:17:52.197030 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-8c3349b5-1489-4ce1-a8d8-2f5df975a4ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Getting quotas for user d079e0264f0e40db9fc93b8f217a7a74 and project bebd859c24cd4ed3b7e32a82de820b8a. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:17:52.240446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8c3349b5-1489-4ce1-a8d8-2f5df975a4ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.284202 Aug 30 05:17:52.249682 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 344/717] 10.222.0.77 () {60 vars in 1159 bytes} [Tue Aug 30 05:17:51 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:52.427507 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] validate_networks() for [('15c65eeb-dfe2-43bb-9925-99f6c334ef61', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:17:52.671629 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1cd3bf53-e67f-45d3-9144-b7d356fcdead tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:52.672939 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1cd3bf53-e67f-45d3-9144-b7d356fcdead tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:52.681933 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cd3bf53-e67f-45d3-9144-b7d356fcdead tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:52.682776 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cd3bf53-e67f-45d3-9144-b7d356fcdead tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:52.683519 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cd3bf53-e67f-45d3-9144-b7d356fcdead tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:52.684458 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cd3bf53-e67f-45d3-9144-b7d356fcdead tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:52.685169 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cd3bf53-e67f-45d3-9144-b7d356fcdead tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:52.685826 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cd3bf53-e67f-45d3-9144-b7d356fcdead tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:52.869729 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1cd3bf53-e67f-45d3-9144-b7d356fcdead tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:52.879250 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1cd3bf53-e67f-45d3-9144-b7d356fcdead tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:52.881060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1cd3bf53-e67f-45d3-9144-b7d356fcdead tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:52.882271 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1cd3bf53-e67f-45d3-9144-b7d356fcdead tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1737 microversion: 2.20 time: 0.214648 Aug 30 05:17:52.897710 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 345/718] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:52 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:17:53.223279 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:17:53.224327 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:17:53.224991 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:17:53.225658 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:17:53.226150 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:17:53.241672 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:53.242714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:53.243543 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:53.245416 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:53.246211 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:53.246966 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:53.282266 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Getting quotas for project 97e3452b02294219ae56cd23eb2aa0ce. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:17:53.287952 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Getting quotas for user 9256fd43e5124fb68d4e5453584d1e8d and project 97e3452b02294219ae56cd23eb2aa0ce. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:17:53.430799 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:17:53.433384 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da47d600-fea3-48cd-8d22-92e7893b5941',volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:17:53.743679 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c7266c5b-fbf9-49d7-a3f5-121a82f2e403 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.579712 Aug 30 05:17:53.750891 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 374/719] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:17:52 2022] POST /compute/v2.1/servers => generated 404 bytes in 1588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 05:17:53.759647 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-56ea9480-0253-4453-92b9-a7a0b6285d6b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:53.762987 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-56ea9480-0253-4453-92b9-a7a0b6285d6b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:53.892875 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-56ea9480-0253-4453-92b9-a7a0b6285d6b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:53.903136 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-56ea9480-0253-4453-92b9-a7a0b6285d6b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1094 microversion: 2.1 time: 0.151379 Aug 30 05:17:53.906607 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-61d95da4-1f4f-4a2c-8149-cf44ccd2e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:53.907323 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-61d95da4-1f4f-4a2c-8149-cf44ccd2e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:53.908630 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 346/720] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:53 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1094 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:53.942078 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61d95da4-1f4f-4a2c-8149-cf44ccd2e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:53.943143 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61d95da4-1f4f-4a2c-8149-cf44ccd2e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:53.944837 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61d95da4-1f4f-4a2c-8149-cf44ccd2e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:53.945760 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61d95da4-1f4f-4a2c-8149-cf44ccd2e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:53.947997 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61d95da4-1f4f-4a2c-8149-cf44ccd2e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:53.949993 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-61d95da4-1f4f-4a2c-8149-cf44ccd2e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:54.201321 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-61d95da4-1f4f-4a2c-8149-cf44ccd2e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:54.221987 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-61d95da4-1f4f-4a2c-8149-cf44ccd2e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:54.223598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-61d95da4-1f4f-4a2c-8149-cf44ccd2e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:54.225343 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-61d95da4-1f4f-4a2c-8149-cf44ccd2e909 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1737 microversion: 2.20 time: 0.323445 Aug 30 05:17:54.226270 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 375/721] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:53 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1737 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:54.613160 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1462366491", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff2f7ffd-21e7-4f75-8a8d-ab24ee6942f2"}], "security_groups": [{"name": "tempest-securitygroup--1544732140"}], "key_name": "tempest-keypair-79741342", "user_data": "}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:54.755986 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] validate_networks() for [('ff2f7ffd-21e7-4f75-8a8d-ab24ee6942f2', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:17:54.929080 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c009c489-3360-458b-a57a-c085b4cddad7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:54.929693 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c009c489-3360-458b-a57a-c085b4cddad7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:54.937212 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c009c489-3360-458b-a57a-c085b4cddad7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:54.942757 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c009c489-3360-458b-a57a-c085b4cddad7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:54.943284 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c009c489-3360-458b-a57a-c085b4cddad7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:54.944714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c009c489-3360-458b-a57a-c085b4cddad7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:54.945415 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c009c489-3360-458b-a57a-c085b4cddad7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:54.946048 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c009c489-3360-458b-a57a-c085b4cddad7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:55.017424 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c009c489-3360-458b-a57a-c085b4cddad7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:55.026391 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c009c489-3360-458b-a57a-c085b4cddad7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1192 microversion: 2.1 time: 0.100999 Aug 30 05:17:55.027246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 376/722] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:54 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1192 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:55.253569 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d071fc41-18a5-4717-8b53-c1ebb5affbe3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:55.254312 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d071fc41-18a5-4717-8b53-c1ebb5affbe3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:55.266043 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d071fc41-18a5-4717-8b53-c1ebb5affbe3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:55.266842 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d071fc41-18a5-4717-8b53-c1ebb5affbe3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:55.267343 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d071fc41-18a5-4717-8b53-c1ebb5affbe3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:55.268444 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d071fc41-18a5-4717-8b53-c1ebb5affbe3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:55.270865 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d071fc41-18a5-4717-8b53-c1ebb5affbe3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:55.271587 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d071fc41-18a5-4717-8b53-c1ebb5affbe3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:55.273320 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:17:55.273780 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:17:55.274198 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:17:55.274864 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:17:55.275430 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:17:55.310889 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:55.311811 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:55.313015 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:55.314870 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:55.317723 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:55.318361 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:55.345775 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Getting quotas for project bebd859c24cd4ed3b7e32a82de820b8a. Resources: {'instances', 'ram', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:17:55.349928 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Getting quotas for user d079e0264f0e40db9fc93b8f217a7a74 and project bebd859c24cd4ed3b7e32a82de820b8a. Resources: {'instances', 'ram', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:17:55.363452 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:17:55.365816 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:17:55.428874 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5111f9f6-8d1c-414f-b3b2-e035b7165646 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.819857 Aug 30 05:17:55.429898 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 347/723] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:17:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:17:55.444578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-65a79b47-c8ec-4cb6-a4d2-e2632ede18a6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:55.446426 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-65a79b47-c8ec-4cb6-a4d2-e2632ede18a6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:55.467368 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d071fc41-18a5-4717-8b53-c1ebb5affbe3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:55.475867 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d071fc41-18a5-4717-8b53-c1ebb5affbe3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:55.477325 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d071fc41-18a5-4717-8b53-c1ebb5affbe3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:55.478782 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d071fc41-18a5-4717-8b53-c1ebb5affbe3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1737 microversion: 2.20 time: 0.230446 Aug 30 05:17:55.500222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 377/724] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:55 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:55.532994 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-65a79b47-c8ec-4cb6-a4d2-e2632ede18a6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:55.540654 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-65a79b47-c8ec-4cb6-a4d2-e2632ede18a6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1240 microversion: 2.1 time: 0.100380 Aug 30 05:17:55.541724 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 348/725] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:55 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1240 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:56.047602 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bf4bbad1-4434-4f9f-bc40-1f5e82be7927 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:56.048319 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bf4bbad1-4434-4f9f-bc40-1f5e82be7927 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:56.055143 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf4bbad1-4434-4f9f-bc40-1f5e82be7927 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:56.055672 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf4bbad1-4434-4f9f-bc40-1f5e82be7927 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:56.056122 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf4bbad1-4434-4f9f-bc40-1f5e82be7927 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:56.056841 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf4bbad1-4434-4f9f-bc40-1f5e82be7927 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:56.057323 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf4bbad1-4434-4f9f-bc40-1f5e82be7927 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:56.057754 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bf4bbad1-4434-4f9f-bc40-1f5e82be7927 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:56.140514 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bf4bbad1-4434-4f9f-bc40-1f5e82be7927 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:56.154468 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bf4bbad1-4434-4f9f-bc40-1f5e82be7927 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1192 microversion: 2.1 time: 0.110580 Aug 30 05:17:56.155738 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 378/726] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:56 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1192 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:56.505605 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9e1bdc43-2e59-445a-9693-6864cf3281b4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:56.506222 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9e1bdc43-2e59-445a-9693-6864cf3281b4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:56.512974 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e1bdc43-2e59-445a-9693-6864cf3281b4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:56.513797 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e1bdc43-2e59-445a-9693-6864cf3281b4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:56.514339 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e1bdc43-2e59-445a-9693-6864cf3281b4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:56.515180 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e1bdc43-2e59-445a-9693-6864cf3281b4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:56.515708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e1bdc43-2e59-445a-9693-6864cf3281b4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:56.516144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9e1bdc43-2e59-445a-9693-6864cf3281b4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:56.521192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:56.562716 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6cef4e89-8416-4067-91a2-73c6159e065d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:56.563498 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6cef4e89-8416-4067-91a2-73c6159e065d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:56.575544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cef4e89-8416-4067-91a2-73c6159e065d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:56.576075 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cef4e89-8416-4067-91a2-73c6159e065d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:56.576518 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cef4e89-8416-4067-91a2-73c6159e065d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:56.577256 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cef4e89-8416-4067-91a2-73c6159e065d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:56.577782 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cef4e89-8416-4067-91a2-73c6159e065d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:56.578213 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6cef4e89-8416-4067-91a2-73c6159e065d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:56.656922 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6cef4e89-8416-4067-91a2-73c6159e065d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:56.667064 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6cef4e89-8416-4067-91a2-73c6159e065d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1292 microversion: 2.1 time: 0.108981 Aug 30 05:17:56.676009 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 379/727] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:56 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1292 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:17:56.793645 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9e1bdc43-2e59-445a-9693-6864cf3281b4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:56.803287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9e1bdc43-2e59-445a-9693-6864cf3281b4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:56.805078 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9e1bdc43-2e59-445a-9693-6864cf3281b4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:56.806474 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9e1bdc43-2e59-445a-9693-6864cf3281b4 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1719 microversion: 2.20 time: 0.304808 Aug 30 05:17:56.807264 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 349/728] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:56 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1719 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:17:57.069293 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-45c676d2-b829-4089-bc51-01444d162e4f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:57.071604 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-45c676d2-b829-4089-bc51-01444d162e4f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:57.082344 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45c676d2-b829-4089-bc51-01444d162e4f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:57.082906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45c676d2-b829-4089-bc51-01444d162e4f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:57.083291 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45c676d2-b829-4089-bc51-01444d162e4f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:57.083979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45c676d2-b829-4089-bc51-01444d162e4f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:57.084435 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45c676d2-b829-4089-bc51-01444d162e4f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:57.084859 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45c676d2-b829-4089-bc51-01444d162e4f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:57.114640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-45c676d2-b829-4089-bc51-01444d162e4f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051564 Aug 30 05:17:57.115152 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 380/729] 10.222.0.77 () {58 vars in 1302 bytes} [Tue Aug 30 05:17:57 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:57.176183 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8a774efb-7040-456d-9fbe-52cf4fc3df54 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:57.177050 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8a774efb-7040-456d-9fbe-52cf4fc3df54 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:57.185667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a774efb-7040-456d-9fbe-52cf4fc3df54 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:57.188802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a774efb-7040-456d-9fbe-52cf4fc3df54 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:57.189417 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a774efb-7040-456d-9fbe-52cf4fc3df54 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:57.193094 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a774efb-7040-456d-9fbe-52cf4fc3df54 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:57.193576 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a774efb-7040-456d-9fbe-52cf4fc3df54 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:57.194021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a774efb-7040-456d-9fbe-52cf4fc3df54 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:57.270975 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a9c126ce-f5fe-42dc-851f-c558665aab9b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:57.271437 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a9c126ce-f5fe-42dc-851f-c558665aab9b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:57.277634 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9c126ce-f5fe-42dc-851f-c558665aab9b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:57.278123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9c126ce-f5fe-42dc-851f-c558665aab9b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:57.279942 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9c126ce-f5fe-42dc-851f-c558665aab9b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:57.280667 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9c126ce-f5fe-42dc-851f-c558665aab9b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:57.281159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9c126ce-f5fe-42dc-851f-c558665aab9b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:57.281558 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a9c126ce-f5fe-42dc-851f-c558665aab9b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:57.324455 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a9c126ce-f5fe-42dc-851f-c558665aab9b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments/e2e32480-472c-4d64-a6d7-82efa349ecb5" status: 200 len: 194 microversion: 2.1 time: 0.058431 Aug 30 05:17:57.330302 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 381/730] 10.222.0.77 () {58 vars in 1413 bytes} [Tue Aug 30 05:17:57 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments/e2e32480-472c-4d64-a6d7-82efa349ecb5 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:17:57.336577 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-35a57666-5cfb-4801-bf6f-c8c423c766c9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:57.346531 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-35a57666-5cfb-4801-bf6f-c8c423c766c9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:57.355838 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35a57666-5cfb-4801-bf6f-c8c423c766c9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:57.356486 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35a57666-5cfb-4801-bf6f-c8c423c766c9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:57.357058 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35a57666-5cfb-4801-bf6f-c8c423c766c9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:57.358248 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35a57666-5cfb-4801-bf6f-c8c423c766c9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:57.358782 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35a57666-5cfb-4801-bf6f-c8c423c766c9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:57.359343 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35a57666-5cfb-4801-bf6f-c8c423c766c9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:57.365596 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8a774efb-7040-456d-9fbe-52cf4fc3df54 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:57.376298 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8a774efb-7040-456d-9fbe-52cf4fc3df54 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1210 microversion: 2.1 time: 0.204319 Aug 30 05:17:57.378410 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 350/731] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:57 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1210 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:57.478565 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-35a57666-5cfb-4801-bf6f-c8c423c766c9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lazy-loading 'services' on Instance uuid 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:17:57.597088 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-35a57666-5cfb-4801-bf6f-c8c423c766c9 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "DELETE /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments/e2e32480-472c-4d64-a6d7-82efa349ecb5" status: 202 len: 0 microversion: 2.1 time: 0.265061 Aug 30 05:17:57.598926 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 382/732] 10.222.0.77 () {58 vars in 1416 bytes} [Tue Aug 30 05:17:57 2022] DELETE /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments/e2e32480-472c-4d64-a6d7-82efa349ecb5 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:17:57.696558 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d419db82-2038-4b46-b767-15543d602f54 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:57.697632 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d419db82-2038-4b46-b767-15543d602f54 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:57.705405 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d419db82-2038-4b46-b767-15543d602f54 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:57.705975 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d419db82-2038-4b46-b767-15543d602f54 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:57.706504 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d419db82-2038-4b46-b767-15543d602f54 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:57.707359 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d419db82-2038-4b46-b767-15543d602f54 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:57.707885 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d419db82-2038-4b46-b767-15543d602f54 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:57.708594 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d419db82-2038-4b46-b767-15543d602f54 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:57.830584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6900b316-74cc-4509-88a3-54b5f7e94084 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:57.831574 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6900b316-74cc-4509-88a3-54b5f7e94084 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:57.838150 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6900b316-74cc-4509-88a3-54b5f7e94084 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:57.838719 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6900b316-74cc-4509-88a3-54b5f7e94084 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:57.839221 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6900b316-74cc-4509-88a3-54b5f7e94084 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:57.839927 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6900b316-74cc-4509-88a3-54b5f7e94084 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:57.840379 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6900b316-74cc-4509-88a3-54b5f7e94084 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:57.841525 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6900b316-74cc-4509-88a3-54b5f7e94084 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:57.893487 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d419db82-2038-4b46-b767-15543d602f54 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:57.902114 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d419db82-2038-4b46-b767-15543d602f54 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1298 microversion: 2.1 time: 0.209840 Aug 30 05:17:57.902114 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 351/733] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:57 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1298 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:57.977904 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6900b316-74cc-4509-88a3-54b5f7e94084 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:57.985975 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6900b316-74cc-4509-88a3-54b5f7e94084 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:57.987460 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6900b316-74cc-4509-88a3-54b5f7e94084 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:57.988617 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6900b316-74cc-4509-88a3-54b5f7e94084 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1719 microversion: 2.20 time: 0.162256 Aug 30 05:17:57.989173 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 383/734] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:57 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:17:58.400265 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eec64e07-699b-4bb8-be37-7ab2be11dcb0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:58.401076 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eec64e07-699b-4bb8-be37-7ab2be11dcb0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:58.408438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eec64e07-699b-4bb8-be37-7ab2be11dcb0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:58.408945 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eec64e07-699b-4bb8-be37-7ab2be11dcb0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:58.409381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eec64e07-699b-4bb8-be37-7ab2be11dcb0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:58.410081 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eec64e07-699b-4bb8-be37-7ab2be11dcb0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:58.410536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eec64e07-699b-4bb8-be37-7ab2be11dcb0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:58.410991 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eec64e07-699b-4bb8-be37-7ab2be11dcb0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:58.924380 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-29bf90a9-8d69-4027-85bf-152c17a88a4c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:58.925834 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-29bf90a9-8d69-4027-85bf-152c17a88a4c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:58.932922 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29bf90a9-8d69-4027-85bf-152c17a88a4c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:58.933522 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29bf90a9-8d69-4027-85bf-152c17a88a4c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:58.934032 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29bf90a9-8d69-4027-85bf-152c17a88a4c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:58.934854 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29bf90a9-8d69-4027-85bf-152c17a88a4c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:58.935390 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29bf90a9-8d69-4027-85bf-152c17a88a4c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:58.935917 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-29bf90a9-8d69-4027-85bf-152c17a88a4c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:58.953756 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eec64e07-699b-4bb8-be37-7ab2be11dcb0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:58.964493 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eec64e07-699b-4bb8-be37-7ab2be11dcb0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.568225 Aug 30 05:17:58.965433 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 352/735] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:58 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:59.013654 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-42723870-e1c2-4f09-9d75-328e964846b5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:59.014557 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-42723870-e1c2-4f09-9d75-328e964846b5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:59.031998 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42723870-e1c2-4f09-9d75-328e964846b5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:59.032506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42723870-e1c2-4f09-9d75-328e964846b5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:59.032948 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42723870-e1c2-4f09-9d75-328e964846b5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:59.033662 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42723870-e1c2-4f09-9d75-328e964846b5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:59.034115 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42723870-e1c2-4f09-9d75-328e964846b5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:59.034537 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-42723870-e1c2-4f09-9d75-328e964846b5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:59.113091 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-29bf90a9-8d69-4027-85bf-152c17a88a4c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:59.122058 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-29bf90a9-8d69-4027-85bf-152c17a88a4c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.202862 Aug 30 05:17:59.123205 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 384/736] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:58 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:59.211302 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-42723870-e1c2-4f09-9d75-328e964846b5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:59.220824 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-42723870-e1c2-4f09-9d75-328e964846b5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:59.222285 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-42723870-e1c2-4f09-9d75-328e964846b5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:59.223506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-42723870-e1c2-4f09-9d75-328e964846b5 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1719 microversion: 2.20 time: 0.215647 Aug 30 05:17:59.224065 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 353/737] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:17:59 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:17:59.724531 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-cb5d6dea-01d3-48a3-a89d-c952682dbd09 req-25584d7d-66bf-4e18-8e75-0e78623afd25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bf81ed-0c85-4375-8e3b-eb18b7a48385", "name": "network-vif-unplugged", "status": "completed", "tag": "1ef774e8-0aae-4b74-9370-1e268ea393a2"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:59.734250 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-cb5d6dea-01d3-48a3-a89d-c952682dbd09 req-25584d7d-66bf-4e18-8e75-0e78623afd25 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:59.734735 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-cb5d6dea-01d3-48a3-a89d-c952682dbd09 req-25584d7d-66bf-4e18-8e75-0e78623afd25 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:59.735188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-cb5d6dea-01d3-48a3-a89d-c952682dbd09 req-25584d7d-66bf-4e18-8e75-0e78623afd25 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:59.746636 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-cb5d6dea-01d3-48a3-a89d-c952682dbd09 req-25584d7d-66bf-4e18-8e75-0e78623afd25 service nova] Creating event network-vif-unplugged:1ef774e8-0aae-4b74-9370-1e268ea393a2 for instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 on hv-cinder-85391 Aug 30 05:17:59.753225 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-cb5d6dea-01d3-48a3-a89d-c952682dbd09 req-25584d7d-66bf-4e18-8e75-0e78623afd25 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097486 Aug 30 05:17:59.753822 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 385/738] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:59.990500 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9919cfc0-440d-46b9-87d1-0f370746ad48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:59.991444 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9919cfc0-440d-46b9-87d1-0f370746ad48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:59.998200 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9919cfc0-440d-46b9-87d1-0f370746ad48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.008875 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9919cfc0-440d-46b9-87d1-0f370746ad48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.009520 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9919cfc0-440d-46b9-87d1-0f370746ad48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.010438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9919cfc0-440d-46b9-87d1-0f370746ad48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.011071 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9919cfc0-440d-46b9-87d1-0f370746ad48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.014537 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9919cfc0-440d-46b9-87d1-0f370746ad48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.143604 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-276b1630-b3ee-4f3d-8b0c-538cdc934f7b tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:00.144403 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-276b1630-b3ee-4f3d-8b0c-538cdc934f7b tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:00.150535 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-276b1630-b3ee-4f3d-8b0c-538cdc934f7b tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.151116 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-276b1630-b3ee-4f3d-8b0c-538cdc934f7b tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.151661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-276b1630-b3ee-4f3d-8b0c-538cdc934f7b tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.152426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-276b1630-b3ee-4f3d-8b0c-538cdc934f7b tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.152943 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-276b1630-b3ee-4f3d-8b0c-538cdc934f7b tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.153461 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-276b1630-b3ee-4f3d-8b0c-538cdc934f7b tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.287087 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-276b1630-b3ee-4f3d-8b0c-538cdc934f7b tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:00.295150 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-276b1630-b3ee-4f3d-8b0c-538cdc934f7b tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.156279 Aug 30 05:18:00.295732 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 386/739] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:00 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:00.300188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-03f941dd-586e-48d9-aceb-b8a87550cc68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:00.300826 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-03f941dd-586e-48d9-aceb-b8a87550cc68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:00.312353 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03f941dd-586e-48d9-aceb-b8a87550cc68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.313128 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03f941dd-586e-48d9-aceb-b8a87550cc68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.313568 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03f941dd-586e-48d9-aceb-b8a87550cc68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.314301 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03f941dd-586e-48d9-aceb-b8a87550cc68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.314848 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03f941dd-586e-48d9-aceb-b8a87550cc68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.315490 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-03f941dd-586e-48d9-aceb-b8a87550cc68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.336731 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9919cfc0-440d-46b9-87d1-0f370746ad48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:00.348779 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9919cfc0-440d-46b9-87d1-0f370746ad48 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.366998 Aug 30 05:18:00.350203 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 354/740] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:59 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:00.491900 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-03f941dd-586e-48d9-aceb-b8a87550cc68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:00.502404 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-03f941dd-586e-48d9-aceb-b8a87550cc68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:00.504218 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-03f941dd-586e-48d9-aceb-b8a87550cc68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:00.505441 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-03f941dd-586e-48d9-aceb-b8a87550cc68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1722 microversion: 2.20 time: 0.208784 Aug 30 05:18:00.506164 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 387/741] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:00 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:00.528618 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-31058ecf-86bd-4c40-a3f1-f0c303b0f9e9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4e357cc-131b-440d-9cb6-2a6638a703f9"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:18:00.531982 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-31058ecf-86bd-4c40-a3f1-f0c303b0f9e9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:00.538355 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31058ecf-86bd-4c40-a3f1-f0c303b0f9e9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.538876 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31058ecf-86bd-4c40-a3f1-f0c303b0f9e9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.539321 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31058ecf-86bd-4c40-a3f1-f0c303b0f9e9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.540027 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31058ecf-86bd-4c40-a3f1-f0c303b0f9e9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.540488 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31058ecf-86bd-4c40-a3f1-f0c303b0f9e9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.540916 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-31058ecf-86bd-4c40-a3f1-f0c303b0f9e9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.886145 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-35890531-3ea7-46bb-a2bb-4fe6752ea996 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:00.886646 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-35890531-3ea7-46bb-a2bb-4fe6752ea996 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:00.895734 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35890531-3ea7-46bb-a2bb-4fe6752ea996 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.896230 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35890531-3ea7-46bb-a2bb-4fe6752ea996 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.896664 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35890531-3ea7-46bb-a2bb-4fe6752ea996 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.897365 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35890531-3ea7-46bb-a2bb-4fe6752ea996 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.897832 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35890531-3ea7-46bb-a2bb-4fe6752ea996 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.898255 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-35890531-3ea7-46bb-a2bb-4fe6752ea996 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.898803 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-31058ecf-86bd-4c40-a3f1-f0c303b0f9e9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "POST /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.373136 Aug 30 05:18:00.899789 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 355/742] 10.222.0.77 () {62 vars in 1364 bytes} [Tue Aug 30 05:18:00 2022] POST /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385/os-volume_attachments => generated 188 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:18:00.931851 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-bdbf6bd3-321a-4875-9580-1ee0cedc88bb req-06561f5d-cc5f-4075-afcd-d312150229a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23b1f7be-c451-470d-8117-4dd0164f568b", "tag": "33dc5fe2-b49b-46cd-bbea-d50e70e21301"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:18:00.950752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-bdbf6bd3-321a-4875-9580-1ee0cedc88bb req-06561f5d-cc5f-4075-afcd-d312150229a2 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.951465 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-bdbf6bd3-321a-4875-9580-1ee0cedc88bb req-06561f5d-cc5f-4075-afcd-d312150229a2 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.952066 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-bdbf6bd3-321a-4875-9580-1ee0cedc88bb req-06561f5d-cc5f-4075-afcd-d312150229a2 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.963911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-35890531-3ea7-46bb-a2bb-4fe6752ea996 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments/80ccef28-bd46-46d3-b559-1001bb95aa95" status: 200 len: 194 microversion: 2.1 time: 0.088146 Aug 30 05:18:00.965520 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-bdbf6bd3-321a-4875-9580-1ee0cedc88bb req-06561f5d-cc5f-4075-afcd-d312150229a2 service nova] Creating event network-changed:33dc5fe2-b49b-46cd-bbea-d50e70e21301 for instance 23b1f7be-c451-470d-8117-4dd0164f568b on hv-cinder-85391 Aug 30 05:18:00.971213 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 388/743] 10.222.0.77 () {58 vars in 1413 bytes} [Tue Aug 30 05:18:00 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments/80ccef28-bd46-46d3-b559-1001bb95aa95 => generated 194 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:00.976864 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d50f2e8f-e7d3-4362-b254-abb79b25432c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:00.977812 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d50f2e8f-e7d3-4362-b254-abb79b25432c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:00.986172 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d50f2e8f-e7d3-4362-b254-abb79b25432c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.987187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d50f2e8f-e7d3-4362-b254-abb79b25432c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.988045 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d50f2e8f-e7d3-4362-b254-abb79b25432c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.989017 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d50f2e8f-e7d3-4362-b254-abb79b25432c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.989655 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d50f2e8f-e7d3-4362-b254-abb79b25432c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.990259 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d50f2e8f-e7d3-4362-b254-abb79b25432c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.994648 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-bdbf6bd3-321a-4875-9580-1ee0cedc88bb req-06561f5d-cc5f-4075-afcd-d312150229a2 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071632 Aug 30 05:18:00.996029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 356/744] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:18:01.066444 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ba136feb-e522-4ad9-8739-c7f9b60b8da2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:01.067737 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ba136feb-e522-4ad9-8739-c7f9b60b8da2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:01.075522 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba136feb-e522-4ad9-8739-c7f9b60b8da2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:01.076240 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba136feb-e522-4ad9-8739-c7f9b60b8da2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:01.076744 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba136feb-e522-4ad9-8739-c7f9b60b8da2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:01.077517 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba136feb-e522-4ad9-8739-c7f9b60b8da2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:01.078061 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba136feb-e522-4ad9-8739-c7f9b60b8da2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:01.078566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ba136feb-e522-4ad9-8739-c7f9b60b8da2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:01.096462 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-d50f2e8f-e7d3-4362-b254-abb79b25432c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lazy-loading 'services' on Instance uuid 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:18:01.101034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:01.176868 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d50f2e8f-e7d3-4362-b254-abb79b25432c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "DELETE /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments/80ccef28-bd46-46d3-b559-1001bb95aa95" status: 202 len: 0 microversion: 2.1 time: 0.203967 Aug 30 05:18:01.178116 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 389/745] 10.222.0.77 () {58 vars in 1416 bytes} [Tue Aug 30 05:18:00 2022] DELETE /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments/80ccef28-bd46-46d3-b559-1001bb95aa95 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:18:01.317291 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b62fbfee-56a7-498d-abac-ae4e053944fd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:01.318251 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b62fbfee-56a7-498d-abac-ae4e053944fd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:01.333606 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b62fbfee-56a7-498d-abac-ae4e053944fd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:01.334397 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b62fbfee-56a7-498d-abac-ae4e053944fd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:01.335031 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b62fbfee-56a7-498d-abac-ae4e053944fd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:01.336436 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b62fbfee-56a7-498d-abac-ae4e053944fd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:01.336943 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b62fbfee-56a7-498d-abac-ae4e053944fd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:01.338421 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b62fbfee-56a7-498d-abac-ae4e053944fd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:01.351468 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ba136feb-e522-4ad9-8739-c7f9b60b8da2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "DELETE /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385/os-volume_attachments/b4e357cc-131b-440d-9cb6-2a6638a703f9" status: 202 len: 0 microversion: 2.20 time: 0.290817 Aug 30 05:18:01.352370 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 357/746] 10.222.0.77 () {60 vars in 1457 bytes} [Tue Aug 30 05:18:01 2022] DELETE /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385/os-volume_attachments/b4e357cc-131b-440d-9cb6-2a6638a703f9 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 05:18:01.383754 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fa7fd87a-1b18-4462-9da0-a57f8ce78a79 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:01.384756 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fa7fd87a-1b18-4462-9da0-a57f8ce78a79 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:01.399524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa7fd87a-1b18-4462-9da0-a57f8ce78a79 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:01.401691 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa7fd87a-1b18-4462-9da0-a57f8ce78a79 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:01.404213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa7fd87a-1b18-4462-9da0-a57f8ce78a79 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:01.405040 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa7fd87a-1b18-4462-9da0-a57f8ce78a79 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:01.406483 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa7fd87a-1b18-4462-9da0-a57f8ce78a79 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:01.407236 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa7fd87a-1b18-4462-9da0-a57f8ce78a79 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:01.497564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b62fbfee-56a7-498d-abac-ae4e053944fd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:01.505479 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b62fbfee-56a7-498d-abac-ae4e053944fd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.192365 Aug 30 05:18:01.506427 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 390/747] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:01 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:18:01.510597 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0abb4b40-b9bf-4256-a78b-9c22bc2d34f7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:18:01.511208 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0abb4b40-b9bf-4256-a78b-9c22bc2d34f7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:01.517567 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0abb4b40-b9bf-4256-a78b-9c22bc2d34f7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:01.518048 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0abb4b40-b9bf-4256-a78b-9c22bc2d34f7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:01.518485 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0abb4b40-b9bf-4256-a78b-9c22bc2d34f7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:01.519197 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0abb4b40-b9bf-4256-a78b-9c22bc2d34f7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:01.519835 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0abb4b40-b9bf-4256-a78b-9c22bc2d34f7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:01.520256 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0abb4b40-b9bf-4256-a78b-9c22bc2d34f7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:01.563930 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0abb4b40-b9bf-4256-a78b-9c22bc2d34f7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120572) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 05:18:01.573647 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fa7fd87a-1b18-4462-9da0-a57f8ce78a79 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:01.581738 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fa7fd87a-1b18-4462-9da0-a57f8ce78a79 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.212417 Aug 30 05:18:01.582387 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 358/748] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:01 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:01.632012 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0abb4b40-b9bf-4256-a78b-9c22bc2d34f7 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "POST /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385/action" status: 202 len: 0 microversion: 2.20 time: 0.124921 Aug 30 05:18:01.632634 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 391/749] 10.222.0.77 () {62 vars in 1319 bytes} [Tue Aug 30 05:18:01 2022] POST /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:18:01.640837 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-cf269192-5916-4a40-9738-2cc76f2b87d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:01.641456 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-cf269192-5916-4a40-9738-2cc76f2b87d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:01.647848 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf269192-5916-4a40-9738-2cc76f2b87d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:01.648545 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf269192-5916-4a40-9738-2cc76f2b87d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:01.649213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf269192-5916-4a40-9738-2cc76f2b87d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:01.650461 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf269192-5916-4a40-9738-2cc76f2b87d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:01.651011 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf269192-5916-4a40-9738-2cc76f2b87d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:01.651438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-cf269192-5916-4a40-9738-2cc76f2b87d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:02.085685 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cf269192-5916-4a40-9738-2cc76f2b87d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:02.101346 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cf269192-5916-4a40-9738-2cc76f2b87d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:02.103435 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-cf269192-5916-4a40-9738-2cc76f2b87d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:02.107565 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-cf269192-5916-4a40-9738-2cc76f2b87d8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1670 microversion: 2.20 time: 0.468068 Aug 30 05:18:02.108320 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 359/750] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:01 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1670 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:02.355638 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-01f6022b-8baa-4058-8a8b-27937a049e19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:02.358007 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-01f6022b-8baa-4058-8a8b-27937a049e19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:02.364773 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01f6022b-8baa-4058-8a8b-27937a049e19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:02.365453 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01f6022b-8baa-4058-8a8b-27937a049e19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:02.365924 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01f6022b-8baa-4058-8a8b-27937a049e19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:02.366593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01f6022b-8baa-4058-8a8b-27937a049e19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:02.367190 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01f6022b-8baa-4058-8a8b-27937a049e19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:02.367494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-01f6022b-8baa-4058-8a8b-27937a049e19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:02.399026 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-01f6022b-8baa-4058-8a8b-27937a049e19 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047107 Aug 30 05:18:02.402971 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 392/751] 10.222.0.77 () {58 vars in 1302 bytes} [Tue Aug 30 05:18:02 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 05:18:02.526506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4cf8b4e4-664a-47b1-9120-2235ead0f76e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:02.527250 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4cf8b4e4-664a-47b1-9120-2235ead0f76e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:02.527621 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0ad1d600-5c54-410d-8646-c1d10934e3b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:02.530365 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0ad1d600-5c54-410d-8646-c1d10934e3b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:02.534015 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cf8b4e4-664a-47b1-9120-2235ead0f76e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:02.534564 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cf8b4e4-664a-47b1-9120-2235ead0f76e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:02.535306 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cf8b4e4-664a-47b1-9120-2235ead0f76e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:02.536091 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cf8b4e4-664a-47b1-9120-2235ead0f76e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:02.536219 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ad1d600-5c54-410d-8646-c1d10934e3b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:02.536627 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cf8b4e4-664a-47b1-9120-2235ead0f76e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:02.536738 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ad1d600-5c54-410d-8646-c1d10934e3b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:02.537099 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ad1d600-5c54-410d-8646-c1d10934e3b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:02.537212 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cf8b4e4-664a-47b1-9120-2235ead0f76e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:02.537796 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ad1d600-5c54-410d-8646-c1d10934e3b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:02.538256 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ad1d600-5c54-410d-8646-c1d10934e3b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:02.538687 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0ad1d600-5c54-410d-8646-c1d10934e3b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:02.567635 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0ad1d600-5c54-410d-8646-c1d10934e3b6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043866 Aug 30 05:18:02.568205 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 393/752] 10.222.0.77 () {58 vars in 1302 bytes} [Tue Aug 30 05:18:02 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 05:18:02.603448 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2cd2d0d0-29b7-4efb-9bbc-d03e241f05e4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:02.604207 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2cd2d0d0-29b7-4efb-9bbc-d03e241f05e4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:02.610796 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2cd2d0d0-29b7-4efb-9bbc-d03e241f05e4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:02.611384 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2cd2d0d0-29b7-4efb-9bbc-d03e241f05e4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:02.612162 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2cd2d0d0-29b7-4efb-9bbc-d03e241f05e4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:02.612949 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2cd2d0d0-29b7-4efb-9bbc-d03e241f05e4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:02.613477 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2cd2d0d0-29b7-4efb-9bbc-d03e241f05e4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:02.614233 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2cd2d0d0-29b7-4efb-9bbc-d03e241f05e4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:02.675646 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4cf8b4e4-664a-47b1-9120-2235ead0f76e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:02.683305 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4cf8b4e4-664a-47b1-9120-2235ead0f76e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.160459 Aug 30 05:18:02.683867 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 360/753] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:02 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:02.693762 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2be6e4b7-d540-4748-aafc-6848c5e8a5e7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:02.693762 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2be6e4b7-d540-4748-aafc-6848c5e8a5e7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:02.695823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2be6e4b7-d540-4748-aafc-6848c5e8a5e7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:02.696398 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2be6e4b7-d540-4748-aafc-6848c5e8a5e7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:02.696898 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2be6e4b7-d540-4748-aafc-6848c5e8a5e7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:02.697595 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2be6e4b7-d540-4748-aafc-6848c5e8a5e7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:02.698048 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2be6e4b7-d540-4748-aafc-6848c5e8a5e7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:02.698465 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2be6e4b7-d540-4748-aafc-6848c5e8a5e7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:02.713996 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:02.726908 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2be6e4b7-d540-4748-aafc-6848c5e8a5e7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:18:02.752080 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2cd2d0d0-29b7-4efb-9bbc-d03e241f05e4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:02.759846 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2cd2d0d0-29b7-4efb-9bbc-d03e241f05e4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.160971 Aug 30 05:18:02.760449 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 394/754] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:02 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:02.801992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2be6e4b7-d540-4748-aafc-6848c5e8a5e7 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "DELETE /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 204 len: 0 microversion: 2.1 time: 0.116465 Aug 30 05:18:02.802552 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 361/755] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:18:02 2022] DELETE /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:18:02.811105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c0513c37-fe67-4bbf-b37f-4481e7423d1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:02.811713 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c0513c37-fe67-4bbf-b37f-4481e7423d1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:02.817566 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0513c37-fe67-4bbf-b37f-4481e7423d1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:02.818040 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0513c37-fe67-4bbf-b37f-4481e7423d1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:02.818472 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0513c37-fe67-4bbf-b37f-4481e7423d1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:02.819190 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0513c37-fe67-4bbf-b37f-4481e7423d1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:02.819640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0513c37-fe67-4bbf-b37f-4481e7423d1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:02.820060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c0513c37-fe67-4bbf-b37f-4481e7423d1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:02.950874 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c0513c37-fe67-4bbf-b37f-4481e7423d1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:02.958546 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c0513c37-fe67-4bbf-b37f-4481e7423d1c tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1671 microversion: 2.1 time: 0.151778 Aug 30 05:18:02.959146 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 395/756] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:02 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:03.055218 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-f67b5dfc-692c-4680-9b3a-dc10bcc0b28f req-a3748a39-76b4-4de5-af70-c726dd0def6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd7486a8-b5d7-45e0-921a-6621d9a10233", "tag": "aa613a15-0a05-4d3e-be80-89172048cffe"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:18:03.065443 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f67b5dfc-692c-4680-9b3a-dc10bcc0b28f req-a3748a39-76b4-4de5-af70-c726dd0def6c service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:03.065917 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f67b5dfc-692c-4680-9b3a-dc10bcc0b28f req-a3748a39-76b4-4de5-af70-c726dd0def6c service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:03.066340 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f67b5dfc-692c-4680-9b3a-dc10bcc0b28f req-a3748a39-76b4-4de5-af70-c726dd0def6c service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:03.076979 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-f67b5dfc-692c-4680-9b3a-dc10bcc0b28f req-a3748a39-76b4-4de5-af70-c726dd0def6c service nova] Creating event network-changed:aa613a15-0a05-4d3e-be80-89172048cffe for instance cd7486a8-b5d7-45e0-921a-6621d9a10233 on hv-cinder-85391 Aug 30 05:18:03.081730 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-f67b5dfc-692c-4680-9b3a-dc10bcc0b28f req-a3748a39-76b4-4de5-af70-c726dd0def6c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030490 Aug 30 05:18:03.082316 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 362/757] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:03.130928 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1bef54e7-8e83-4db0-8222-4726e7cc6994 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:03.131543 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1bef54e7-8e83-4db0-8222-4726e7cc6994 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:03.137981 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1bef54e7-8e83-4db0-8222-4726e7cc6994 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:03.138469 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1bef54e7-8e83-4db0-8222-4726e7cc6994 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:03.138937 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1bef54e7-8e83-4db0-8222-4726e7cc6994 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:03.139629 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1bef54e7-8e83-4db0-8222-4726e7cc6994 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:03.140089 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1bef54e7-8e83-4db0-8222-4726e7cc6994 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:03.140514 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1bef54e7-8e83-4db0-8222-4726e7cc6994 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:03.263593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:03.267306 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1bef54e7-8e83-4db0-8222-4726e7cc6994 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:03.275482 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1bef54e7-8e83-4db0-8222-4726e7cc6994 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:03.276912 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1bef54e7-8e83-4db0-8222-4726e7cc6994 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:03.278673 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1bef54e7-8e83-4db0-8222-4726e7cc6994 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1670 microversion: 2.20 time: 0.151668 Aug 30 05:18:03.279278 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 396/758] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:03 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:03.704781 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2dbb0990-9c38-4507-9a89-4a690c8ab980 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:03.705487 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2dbb0990-9c38-4507-9a89-4a690c8ab980 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:03.711697 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dbb0990-9c38-4507-9a89-4a690c8ab980 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:03.712202 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dbb0990-9c38-4507-9a89-4a690c8ab980 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:03.712693 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dbb0990-9c38-4507-9a89-4a690c8ab980 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:03.713395 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dbb0990-9c38-4507-9a89-4a690c8ab980 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:03.713855 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dbb0990-9c38-4507-9a89-4a690c8ab980 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:03.714286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2dbb0990-9c38-4507-9a89-4a690c8ab980 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:03.781041 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-48a9815d-5330-4946-be97-036ee8f0cff1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:03.781755 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-48a9815d-5330-4946-be97-036ee8f0cff1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:03.783673 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:03.789697 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48a9815d-5330-4946-be97-036ee8f0cff1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:03.790194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48a9815d-5330-4946-be97-036ee8f0cff1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:03.790623 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48a9815d-5330-4946-be97-036ee8f0cff1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:03.791525 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48a9815d-5330-4946-be97-036ee8f0cff1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:03.791977 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48a9815d-5330-4946-be97-036ee8f0cff1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:03.792402 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48a9815d-5330-4946-be97-036ee8f0cff1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:03.846659 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2dbb0990-9c38-4507-9a89-4a690c8ab980 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:03.854630 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2dbb0990-9c38-4507-9a89-4a690c8ab980 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.154736 Aug 30 05:18:03.855245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 363/759] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:03 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:03.923433 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-48a9815d-5330-4946-be97-036ee8f0cff1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:03.931009 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-48a9815d-5330-4946-be97-036ee8f0cff1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.153794 Aug 30 05:18:03.931575 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 397/760] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:03 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:18:03.979288 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c9ec7498-a99e-4738-97f3-bd1e88cb20d0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:03.979899 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c9ec7498-a99e-4738-97f3-bd1e88cb20d0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:03.986164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9ec7498-a99e-4738-97f3-bd1e88cb20d0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:03.986639 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9ec7498-a99e-4738-97f3-bd1e88cb20d0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:03.987107 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9ec7498-a99e-4738-97f3-bd1e88cb20d0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:03.987790 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9ec7498-a99e-4738-97f3-bd1e88cb20d0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:03.988238 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9ec7498-a99e-4738-97f3-bd1e88cb20d0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:03.988657 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c9ec7498-a99e-4738-97f3-bd1e88cb20d0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:04.113248 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c9ec7498-a99e-4738-97f3-bd1e88cb20d0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:04.120874 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c9ec7498-a99e-4738-97f3-bd1e88cb20d0 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1671 microversion: 2.1 time: 0.145364 Aug 30 05:18:04.121448 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 364/761] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:03 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1671 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:04.301505 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ceaba21a-c3ba-42d3-8d00-534569e0f3ae tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:04.302114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ceaba21a-c3ba-42d3-8d00-534569e0f3ae tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:04.308012 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ceaba21a-c3ba-42d3-8d00-534569e0f3ae tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:04.308528 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ceaba21a-c3ba-42d3-8d00-534569e0f3ae tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:04.308965 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ceaba21a-c3ba-42d3-8d00-534569e0f3ae tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:04.309683 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ceaba21a-c3ba-42d3-8d00-534569e0f3ae tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:04.310135 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ceaba21a-c3ba-42d3-8d00-534569e0f3ae tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:04.310560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ceaba21a-c3ba-42d3-8d00-534569e0f3ae tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:04.434733 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ceaba21a-c3ba-42d3-8d00-534569e0f3ae tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:04.442707 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ceaba21a-c3ba-42d3-8d00-534569e0f3ae tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:04.444172 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ceaba21a-c3ba-42d3-8d00-534569e0f3ae tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:04.445323 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ceaba21a-c3ba-42d3-8d00-534569e0f3ae tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1670 microversion: 2.20 time: 0.147727 Aug 30 05:18:04.445880 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 398/762] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:04 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1670 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:04.875811 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5562b02f-8164-433b-9f5b-03bad5b0c4f5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:04.876420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5562b02f-8164-433b-9f5b-03bad5b0c4f5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:04.882284 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5562b02f-8164-433b-9f5b-03bad5b0c4f5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:04.882770 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5562b02f-8164-433b-9f5b-03bad5b0c4f5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:04.883231 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5562b02f-8164-433b-9f5b-03bad5b0c4f5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:04.883916 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5562b02f-8164-433b-9f5b-03bad5b0c4f5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:04.884368 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5562b02f-8164-433b-9f5b-03bad5b0c4f5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:04.884787 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5562b02f-8164-433b-9f5b-03bad5b0c4f5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:04.951890 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7bca5a29-8346-4da2-bf55-77118696c8b6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:04.952503 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7bca5a29-8346-4da2-bf55-77118696c8b6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:04.959078 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bca5a29-8346-4da2-bf55-77118696c8b6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:04.959583 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bca5a29-8346-4da2-bf55-77118696c8b6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:04.960084 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bca5a29-8346-4da2-bf55-77118696c8b6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:04.960807 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bca5a29-8346-4da2-bf55-77118696c8b6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:04.961421 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bca5a29-8346-4da2-bf55-77118696c8b6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:04.961854 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7bca5a29-8346-4da2-bf55-77118696c8b6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:05.020225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5562b02f-8164-433b-9f5b-03bad5b0c4f5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:05.027821 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5562b02f-8164-433b-9f5b-03bad5b0c4f5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.156491 Aug 30 05:18:05.028912 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 365/763] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:04 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:05.092298 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7bca5a29-8346-4da2-bf55-77118696c8b6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:05.100076 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7bca5a29-8346-4da2-bf55-77118696c8b6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.152080 Aug 30 05:18:05.100645 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 399/764] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:04 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:05.141851 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-887e12aa-2c12-4341-b6a6-ad066632b61f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:05.142467 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-887e12aa-2c12-4341-b6a6-ad066632b61f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:05.148736 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-887e12aa-2c12-4341-b6a6-ad066632b61f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:05.149222 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-887e12aa-2c12-4341-b6a6-ad066632b61f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:05.149660 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-887e12aa-2c12-4341-b6a6-ad066632b61f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:05.150354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-887e12aa-2c12-4341-b6a6-ad066632b61f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:05.150811 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-887e12aa-2c12-4341-b6a6-ad066632b61f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:05.151257 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-887e12aa-2c12-4341-b6a6-ad066632b61f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:05.335346 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:05.468212 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b2c62c03-e9d6-4f96-b393-d05f5b41f171 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:05.469741 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b2c62c03-e9d6-4f96-b393-d05f5b41f171 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:05.476057 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2c62c03-e9d6-4f96-b393-d05f5b41f171 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:05.476552 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2c62c03-e9d6-4f96-b393-d05f5b41f171 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:05.477020 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2c62c03-e9d6-4f96-b393-d05f5b41f171 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:05.477981 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2c62c03-e9d6-4f96-b393-d05f5b41f171 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:05.478637 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2c62c03-e9d6-4f96-b393-d05f5b41f171 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:05.479111 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b2c62c03-e9d6-4f96-b393-d05f5b41f171 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:05.540235 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=14 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:05.741295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b2c62c03-e9d6-4f96-b393-d05f5b41f171 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:05.757808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b2c62c03-e9d6-4f96-b393-d05f5b41f171 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:05.759285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b2c62c03-e9d6-4f96-b393-d05f5b41f171 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:05.760742 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b2c62c03-e9d6-4f96-b393-d05f5b41f171 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1672 microversion: 2.20 time: 0.297330 Aug 30 05:18:05.775396 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 400/765] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:05 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1672 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:18:05.827454 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-887e12aa-2c12-4341-b6a6-ad066632b61f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:05.840835 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-887e12aa-2c12-4341-b6a6-ad066632b61f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1671 microversion: 2.1 time: 0.702638 Aug 30 05:18:05.855617 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 366/766] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:05 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1671 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:06.050554 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-04c087da-30f2-49bd-81e7-553ba314e211 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:06.051275 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-04c087da-30f2-49bd-81e7-553ba314e211 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:06.058276 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04c087da-30f2-49bd-81e7-553ba314e211 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:06.059061 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04c087da-30f2-49bd-81e7-553ba314e211 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:06.060213 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04c087da-30f2-49bd-81e7-553ba314e211 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:06.060927 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04c087da-30f2-49bd-81e7-553ba314e211 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:06.061556 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04c087da-30f2-49bd-81e7-553ba314e211 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:06.061982 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-04c087da-30f2-49bd-81e7-553ba314e211 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:06.123054 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aa7bb65a-43e6-4839-8008-de1a4f4dfbfa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:06.124444 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-aa7bb65a-43e6-4839-8008-de1a4f4dfbfa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:06.131340 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa7bb65a-43e6-4839-8008-de1a4f4dfbfa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:06.132716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa7bb65a-43e6-4839-8008-de1a4f4dfbfa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:06.133585 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa7bb65a-43e6-4839-8008-de1a4f4dfbfa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:06.135114 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa7bb65a-43e6-4839-8008-de1a4f4dfbfa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:06.137686 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa7bb65a-43e6-4839-8008-de1a4f4dfbfa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:06.138366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aa7bb65a-43e6-4839-8008-de1a4f4dfbfa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:06.511674 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aa7bb65a-43e6-4839-8008-de1a4f4dfbfa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:06.519317 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aa7bb65a-43e6-4839-8008-de1a4f4dfbfa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.401499 Aug 30 05:18:06.520015 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 367/767] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:06 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:06.538630 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-04c087da-30f2-49bd-81e7-553ba314e211 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:06.547267 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-04c087da-30f2-49bd-81e7-553ba314e211 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.500690 Aug 30 05:18:06.547836 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 401/768] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:06 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:06.785452 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6c0721e4-3df9-4e64-aad4-e3b5f5942f63 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:06.786071 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6c0721e4-3df9-4e64-aad4-e3b5f5942f63 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:06.793031 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c0721e4-3df9-4e64-aad4-e3b5f5942f63 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:06.793519 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c0721e4-3df9-4e64-aad4-e3b5f5942f63 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:06.809301 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c0721e4-3df9-4e64-aad4-e3b5f5942f63 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:06.810493 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c0721e4-3df9-4e64-aad4-e3b5f5942f63 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:06.812134 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c0721e4-3df9-4e64-aad4-e3b5f5942f63 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:06.812134 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6c0721e4-3df9-4e64-aad4-e3b5f5942f63 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:06.862208 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-02208a03-3f66-45d1-9113-5c4a1cac2050 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:06.862904 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-02208a03-3f66-45d1-9113-5c4a1cac2050 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:06.869621 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02208a03-3f66-45d1-9113-5c4a1cac2050 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:06.870196 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02208a03-3f66-45d1-9113-5c4a1cac2050 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:06.870808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02208a03-3f66-45d1-9113-5c4a1cac2050 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:06.871640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02208a03-3f66-45d1-9113-5c4a1cac2050 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:06.872298 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02208a03-3f66-45d1-9113-5c4a1cac2050 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:06.872813 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-02208a03-3f66-45d1-9113-5c4a1cac2050 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:06.957450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6c0721e4-3df9-4e64-aad4-e3b5f5942f63 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:06.967501 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6c0721e4-3df9-4e64-aad4-e3b5f5942f63 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:06.968235 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-02208a03-3f66-45d1-9113-5c4a1cac2050 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:06.969192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6c0721e4-3df9-4e64-aad4-e3b5f5942f63 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:06.970569 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6c0721e4-3df9-4e64-aad4-e3b5f5942f63 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.188944 Aug 30 05:18:06.971721 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 368/769] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:06 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:06.979243 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-02208a03-3f66-45d1-9113-5c4a1cac2050 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1603 microversion: 2.1 time: 0.120943 Aug 30 05:18:06.979914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 402/770] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:06 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1603 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:07.493994 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-3ef7656b-6217-44f9-99a5-1eec1dd59771 req-9986dfc4-176c-4a81-981b-32953d63898d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4", "name": "network-vif-deleted", "tag": "daced90f-36b0-406a-98c8-834fd146d1c8"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:18:07.509631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-3ef7656b-6217-44f9-99a5-1eec1dd59771 req-9986dfc4-176c-4a81-981b-32953d63898d service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:07.510114 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-3ef7656b-6217-44f9-99a5-1eec1dd59771 req-9986dfc4-176c-4a81-981b-32953d63898d service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:07.510558 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-3ef7656b-6217-44f9-99a5-1eec1dd59771 req-9986dfc4-176c-4a81-981b-32953d63898d service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:07.524502 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-3ef7656b-6217-44f9-99a5-1eec1dd59771 req-9986dfc4-176c-4a81-981b-32953d63898d service nova] Creating event network-vif-deleted:daced90f-36b0-406a-98c8-834fd146d1c8 for instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 on hv-cinder-85391 Aug 30 05:18:07.532848 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-3ef7656b-6217-44f9-99a5-1eec1dd59771 req-9986dfc4-176c-4a81-981b-32953d63898d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111788 Aug 30 05:18:07.533773 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 369/771] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:07.540695 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1d5ea92a-0391-4eff-87e3-955da15a89c3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:07.541980 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1d5ea92a-0391-4eff-87e3-955da15a89c3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:07.549388 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d5ea92a-0391-4eff-87e3-955da15a89c3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:07.550154 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d5ea92a-0391-4eff-87e3-955da15a89c3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:07.550534 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d5ea92a-0391-4eff-87e3-955da15a89c3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:07.551311 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d5ea92a-0391-4eff-87e3-955da15a89c3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:07.551789 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d5ea92a-0391-4eff-87e3-955da15a89c3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:07.552249 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d5ea92a-0391-4eff-87e3-955da15a89c3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:07.571343 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-64d9828d-5dc0-4715-89f9-2e892cbaa479 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:07.573123 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-64d9828d-5dc0-4715-89f9-2e892cbaa479 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:07.581443 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64d9828d-5dc0-4715-89f9-2e892cbaa479 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:07.582925 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64d9828d-5dc0-4715-89f9-2e892cbaa479 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:07.583611 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64d9828d-5dc0-4715-89f9-2e892cbaa479 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:07.584697 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64d9828d-5dc0-4715-89f9-2e892cbaa479 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:07.585398 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64d9828d-5dc0-4715-89f9-2e892cbaa479 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:07.586045 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64d9828d-5dc0-4715-89f9-2e892cbaa479 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:07.736935 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1d5ea92a-0391-4eff-87e3-955da15a89c3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:07.746535 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1d5ea92a-0391-4eff-87e3-955da15a89c3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.208683 Aug 30 05:18:07.748230 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 403/772] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:07 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:07.792860 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-64d9828d-5dc0-4715-89f9-2e892cbaa479 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:07.803061 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-64d9828d-5dc0-4715-89f9-2e892cbaa479 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.238575 Aug 30 05:18:07.804007 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 370/773] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:07 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:18:07.993426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-912e81a0-5b4c-4857-8e94-a8426abf3c68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:07.995179 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-912e81a0-5b4c-4857-8e94-a8426abf3c68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:08.000092 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0d7e1a93-608f-4d83-a928-b24b44209b7b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:08.000712 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0d7e1a93-608f-4d83-a928-b24b44209b7b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:08.011100 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d7e1a93-608f-4d83-a928-b24b44209b7b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:08.014036 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-912e81a0-5b4c-4857-8e94-a8426abf3c68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:08.014782 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d7e1a93-608f-4d83-a928-b24b44209b7b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:08.015937 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d7e1a93-608f-4d83-a928-b24b44209b7b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:08.016638 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d7e1a93-608f-4d83-a928-b24b44209b7b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:08.017145 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d7e1a93-608f-4d83-a928-b24b44209b7b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:08.018163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-912e81a0-5b4c-4857-8e94-a8426abf3c68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:08.018663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-912e81a0-5b4c-4857-8e94-a8426abf3c68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:08.019412 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-912e81a0-5b4c-4857-8e94-a8426abf3c68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:08.019861 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-912e81a0-5b4c-4857-8e94-a8426abf3c68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:08.020249 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d7e1a93-608f-4d83-a928-b24b44209b7b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:08.021923 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-912e81a0-5b4c-4857-8e94-a8426abf3c68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:08.100633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d7e1a93-608f-4d83-a928-b24b44209b7b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:08.101773 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d7e1a93-608f-4d83-a928-b24b44209b7b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:08.103449 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0d7e1a93-608f-4d83-a928-b24b44209b7b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:08.103922 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-0d7e1a93-608f-4d83-a928-b24b44209b7b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lazy-loading 'fault' on Instance uuid 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:18:08.177914 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0d7e1a93-608f-4d83-a928-b24b44209b7b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:08.196399 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0d7e1a93-608f-4d83-a928-b24b44209b7b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1326 microversion: 2.1 time: 0.197730 Aug 30 05:18:08.198698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 371/774] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:07 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1326 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:18:08.213599 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-f9c51464-5708-4f53-9296-e6b4d6d19895 req-b3a6a654-49dc-4a5d-8e6b-b8f3f32c8e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd7486a8-b5d7-45e0-921a-6621d9a10233", "name": "network-vif-plugged", "status": "completed", "tag": "aa613a15-0a05-4d3e-be80-89172048cffe"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:18:08.240545 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f9c51464-5708-4f53-9296-e6b4d6d19895 req-b3a6a654-49dc-4a5d-8e6b-b8f3f32c8e6f service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:08.241400 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f9c51464-5708-4f53-9296-e6b4d6d19895 req-b3a6a654-49dc-4a5d-8e6b-b8f3f32c8e6f service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:08.241849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-f9c51464-5708-4f53-9296-e6b4d6d19895 req-b3a6a654-49dc-4a5d-8e6b-b8f3f32c8e6f service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:08.255827 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-f9c51464-5708-4f53-9296-e6b4d6d19895 req-b3a6a654-49dc-4a5d-8e6b-b8f3f32c8e6f service nova] Creating event network-vif-plugged:aa613a15-0a05-4d3e-be80-89172048cffe for instance cd7486a8-b5d7-45e0-921a-6621d9a10233 on hv-cinder-85391 Aug 30 05:18:08.260863 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-f9c51464-5708-4f53-9296-e6b4d6d19895 req-b3a6a654-49dc-4a5d-8e6b-b8f3f32c8e6f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060907 Aug 30 05:18:08.262083 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 372/775] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:08.531443 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-912e81a0-5b4c-4857-8e94-a8426abf3c68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:08.544279 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-912e81a0-5b4c-4857-8e94-a8426abf3c68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:08.547254 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-912e81a0-5b4c-4857-8e94-a8426abf3c68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:08.549296 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-912e81a0-5b4c-4857-8e94-a8426abf3c68 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.559582 Aug 30 05:18:08.567936 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 404/776] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:07 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:08.770670 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9f82424f-3c6d-46bb-a5fb-d8a0c0663e7c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:08.771330 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9f82424f-3c6d-46bb-a5fb-d8a0c0663e7c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:08.773297 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:08.779837 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f82424f-3c6d-46bb-a5fb-d8a0c0663e7c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:08.780479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f82424f-3c6d-46bb-a5fb-d8a0c0663e7c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:08.781026 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f82424f-3c6d-46bb-a5fb-d8a0c0663e7c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:08.781945 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f82424f-3c6d-46bb-a5fb-d8a0c0663e7c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:08.782452 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f82424f-3c6d-46bb-a5fb-d8a0c0663e7c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:08.782970 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9f82424f-3c6d-46bb-a5fb-d8a0c0663e7c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:08.829464 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b20ffa97-a3ae-4531-948b-78ac6783a1da tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:08.831573 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b20ffa97-a3ae-4531-948b-78ac6783a1da tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:08.841965 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b20ffa97-a3ae-4531-948b-78ac6783a1da tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:08.842724 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b20ffa97-a3ae-4531-948b-78ac6783a1da tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:08.843357 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b20ffa97-a3ae-4531-948b-78ac6783a1da tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:08.844364 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b20ffa97-a3ae-4531-948b-78ac6783a1da tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:08.844975 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b20ffa97-a3ae-4531-948b-78ac6783a1da tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:08.845608 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b20ffa97-a3ae-4531-948b-78ac6783a1da tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:08.851056 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:09.017107 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9f82424f-3c6d-46bb-a5fb-d8a0c0663e7c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:09.027621 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9f82424f-3c6d-46bb-a5fb-d8a0c0663e7c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.261637 Aug 30 05:18:09.031253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 373/777] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:08 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:09.064803 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b20ffa97-a3ae-4531-948b-78ac6783a1da tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:09.072673 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b20ffa97-a3ae-4531-948b-78ac6783a1da tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.252123 Aug 30 05:18:09.073254 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 405/778] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:08 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:09.220426 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1d88add2-8573-44c5-8733-ce5a117dff95 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:09.221029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1d88add2-8573-44c5-8733-ce5a117dff95 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:09.227080 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d88add2-8573-44c5-8733-ce5a117dff95 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:09.227565 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d88add2-8573-44c5-8733-ce5a117dff95 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:09.228000 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d88add2-8573-44c5-8733-ce5a117dff95 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:09.228688 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d88add2-8573-44c5-8733-ce5a117dff95 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:09.229144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d88add2-8573-44c5-8733-ce5a117dff95 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:09.229569 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d88add2-8573-44c5-8733-ce5a117dff95 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:09.260854 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d88add2-8573-44c5-8733-ce5a117dff95 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:09.261338 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d88add2-8573-44c5-8733-ce5a117dff95 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:09.261773 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1d88add2-8573-44c5-8733-ce5a117dff95 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:09.262219 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-1d88add2-8573-44c5-8733-ce5a117dff95 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lazy-loading 'fault' on Instance uuid 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:18:09.302155 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1d88add2-8573-44c5-8733-ce5a117dff95 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:09.310365 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1d88add2-8573-44c5-8733-ce5a117dff95 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1326 microversion: 2.1 time: 0.094084 Aug 30 05:18:09.310953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 374/779] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:09 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1326 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:09.575773 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-adae2950-9e40-4052-9ee9-2be92f312f9d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:09.576477 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-adae2950-9e40-4052-9ee9-2be92f312f9d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:09.582561 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-adae2950-9e40-4052-9ee9-2be92f312f9d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:09.583075 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-adae2950-9e40-4052-9ee9-2be92f312f9d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:09.583503 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-adae2950-9e40-4052-9ee9-2be92f312f9d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:09.584434 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-adae2950-9e40-4052-9ee9-2be92f312f9d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:09.584892 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-adae2950-9e40-4052-9ee9-2be92f312f9d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:09.585311 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-adae2950-9e40-4052-9ee9-2be92f312f9d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:09.721941 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-adae2950-9e40-4052-9ee9-2be92f312f9d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:09.729913 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-adae2950-9e40-4052-9ee9-2be92f312f9d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:09.731949 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-adae2950-9e40-4052-9ee9-2be92f312f9d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:09.733167 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-adae2950-9e40-4052-9ee9-2be92f312f9d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.161634 Aug 30 05:18:09.733753 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 406/780] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:09 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:10.048013 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1cdf7121-cf82-4c09-8e57-a8eccb3c1309 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:10.048759 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1cdf7121-cf82-4c09-8e57-a8eccb3c1309 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:10.055381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cdf7121-cf82-4c09-8e57-a8eccb3c1309 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:10.055872 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cdf7121-cf82-4c09-8e57-a8eccb3c1309 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:10.056306 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cdf7121-cf82-4c09-8e57-a8eccb3c1309 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:10.057002 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cdf7121-cf82-4c09-8e57-a8eccb3c1309 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:10.057458 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cdf7121-cf82-4c09-8e57-a8eccb3c1309 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:10.057884 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cdf7121-cf82-4c09-8e57-a8eccb3c1309 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:10.095440 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cbaeb063-e54d-4606-87fd-fbc0b715ec26 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:10.096086 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cbaeb063-e54d-4606-87fd-fbc0b715ec26 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:10.105174 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cbaeb063-e54d-4606-87fd-fbc0b715ec26 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:10.105672 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cbaeb063-e54d-4606-87fd-fbc0b715ec26 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:10.106155 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cbaeb063-e54d-4606-87fd-fbc0b715ec26 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:10.106893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cbaeb063-e54d-4606-87fd-fbc0b715ec26 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:10.107352 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cbaeb063-e54d-4606-87fd-fbc0b715ec26 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:10.107780 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cbaeb063-e54d-4606-87fd-fbc0b715ec26 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:10.249650 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1cdf7121-cf82-4c09-8e57-a8eccb3c1309 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:10.257256 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1cdf7121-cf82-4c09-8e57-a8eccb3c1309 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.213227 Aug 30 05:18:10.257825 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 375/781] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:10 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:10.270033 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cbaeb063-e54d-4606-87fd-fbc0b715ec26 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:10.277629 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cbaeb063-e54d-4606-87fd-fbc0b715ec26 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.188262 Aug 30 05:18:10.278258 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 407/782] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:10 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:18:10.331935 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7c26d667-6992-457c-8e1b-bf77dd80b7ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:10.332552 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7c26d667-6992-457c-8e1b-bf77dd80b7ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:10.338365 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c26d667-6992-457c-8e1b-bf77dd80b7ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:10.338888 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c26d667-6992-457c-8e1b-bf77dd80b7ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:10.339329 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c26d667-6992-457c-8e1b-bf77dd80b7ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:10.340017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c26d667-6992-457c-8e1b-bf77dd80b7ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:10.340472 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c26d667-6992-457c-8e1b-bf77dd80b7ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:10.341142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c26d667-6992-457c-8e1b-bf77dd80b7ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:10.369997 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c26d667-6992-457c-8e1b-bf77dd80b7ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:10.370472 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c26d667-6992-457c-8e1b-bf77dd80b7ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:10.370942 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7c26d667-6992-457c-8e1b-bf77dd80b7ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:10.371387 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-7c26d667-6992-457c-8e1b-bf77dd80b7ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lazy-loading 'fault' on Instance uuid 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:18:10.414492 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7c26d667-6992-457c-8e1b-bf77dd80b7ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:10.422105 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7c26d667-6992-457c-8e1b-bf77dd80b7ef tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1326 microversion: 2.1 time: 0.094011 Aug 30 05:18:10.422671 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 376/783] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:10 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1326 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:10.755940 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9fc5aa61-6d52-4fa8-8470-86a4f8f9d861 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:10.756484 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9fc5aa61-6d52-4fa8-8470-86a4f8f9d861 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:10.762704 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9fc5aa61-6d52-4fa8-8470-86a4f8f9d861 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:10.763214 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9fc5aa61-6d52-4fa8-8470-86a4f8f9d861 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:10.763646 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9fc5aa61-6d52-4fa8-8470-86a4f8f9d861 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:10.764324 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9fc5aa61-6d52-4fa8-8470-86a4f8f9d861 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:10.764774 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9fc5aa61-6d52-4fa8-8470-86a4f8f9d861 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:10.765191 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9fc5aa61-6d52-4fa8-8470-86a4f8f9d861 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:10.911342 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9fc5aa61-6d52-4fa8-8470-86a4f8f9d861 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:10.920215 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9fc5aa61-6d52-4fa8-8470-86a4f8f9d861 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:10.922030 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9fc5aa61-6d52-4fa8-8470-86a4f8f9d861 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:10.923236 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9fc5aa61-6d52-4fa8-8470-86a4f8f9d861 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.171242 Aug 30 05:18:10.923951 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 408/784] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:10 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:11.277527 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-301a7473-db80-43e8-88dd-6e6a976d3395 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:11.278145 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-301a7473-db80-43e8-88dd-6e6a976d3395 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:11.285171 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-301a7473-db80-43e8-88dd-6e6a976d3395 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:11.285674 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-301a7473-db80-43e8-88dd-6e6a976d3395 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:11.286120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-301a7473-db80-43e8-88dd-6e6a976d3395 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:11.286842 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-301a7473-db80-43e8-88dd-6e6a976d3395 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:11.287313 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-301a7473-db80-43e8-88dd-6e6a976d3395 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:11.287738 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-301a7473-db80-43e8-88dd-6e6a976d3395 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:11.298074 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-15c62085-9232-49fb-80bb-b773a89a2e23 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:11.298685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-15c62085-9232-49fb-80bb-b773a89a2e23 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:11.302767 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:11.304993 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15c62085-9232-49fb-80bb-b773a89a2e23 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:11.305617 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15c62085-9232-49fb-80bb-b773a89a2e23 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:11.306057 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15c62085-9232-49fb-80bb-b773a89a2e23 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:11.306756 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15c62085-9232-49fb-80bb-b773a89a2e23 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:11.307237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15c62085-9232-49fb-80bb-b773a89a2e23 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:11.307694 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-15c62085-9232-49fb-80bb-b773a89a2e23 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:11.420778 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-301a7473-db80-43e8-88dd-6e6a976d3395 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:11.429368 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-301a7473-db80-43e8-88dd-6e6a976d3395 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.155567 Aug 30 05:18:11.430262 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 377/785] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:11 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:11.442757 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-15c62085-9232-49fb-80bb-b773a89a2e23 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:11.460901 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-15c62085-9232-49fb-80bb-b773a89a2e23 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.165983 Aug 30 05:18:11.461881 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 409/786] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:11 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:18:11.476587 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-99a6c97f-ace4-4b13-8409-503cfa95fd8f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:11.478029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-99a6c97f-ace4-4b13-8409-503cfa95fd8f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:11.485570 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99a6c97f-ace4-4b13-8409-503cfa95fd8f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:11.486471 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99a6c97f-ace4-4b13-8409-503cfa95fd8f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:11.487301 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99a6c97f-ace4-4b13-8409-503cfa95fd8f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:11.488821 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99a6c97f-ace4-4b13-8409-503cfa95fd8f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:11.489548 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99a6c97f-ace4-4b13-8409-503cfa95fd8f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:11.490159 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99a6c97f-ace4-4b13-8409-503cfa95fd8f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:11.523858 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99a6c97f-ace4-4b13-8409-503cfa95fd8f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:11.524838 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99a6c97f-ace4-4b13-8409-503cfa95fd8f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:11.525611 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-99a6c97f-ace4-4b13-8409-503cfa95fd8f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:11.526226 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-99a6c97f-ace4-4b13-8409-503cfa95fd8f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lazy-loading 'fault' on Instance uuid 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:18:11.567701 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-99a6c97f-ace4-4b13-8409-503cfa95fd8f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:11.576215 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-99a6c97f-ace4-4b13-8409-503cfa95fd8f tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1326 microversion: 2.1 time: 0.123341 Aug 30 05:18:11.576790 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 378/787] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:11 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1326 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:11.945462 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b851ae93-b694-4720-b604-a5d5f0d8aec6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:11.946079 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b851ae93-b694-4720-b604-a5d5f0d8aec6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:11.953100 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b851ae93-b694-4720-b604-a5d5f0d8aec6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:11.953628 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b851ae93-b694-4720-b604-a5d5f0d8aec6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:11.954140 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b851ae93-b694-4720-b604-a5d5f0d8aec6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:11.954933 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b851ae93-b694-4720-b604-a5d5f0d8aec6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:11.955448 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b851ae93-b694-4720-b604-a5d5f0d8aec6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:11.955936 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b851ae93-b694-4720-b604-a5d5f0d8aec6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:12.089032 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b851ae93-b694-4720-b604-a5d5f0d8aec6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:12.097314 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b851ae93-b694-4720-b604-a5d5f0d8aec6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:12.098763 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b851ae93-b694-4720-b604-a5d5f0d8aec6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:12.100003 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b851ae93-b694-4720-b604-a5d5f0d8aec6 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.158414 Aug 30 05:18:12.100574 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 410/788] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:11 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:12.454320 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-abb33416-ea8b-4fd5-adeb-941e204232d6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:12.454973 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-abb33416-ea8b-4fd5-adeb-941e204232d6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:12.461372 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abb33416-ea8b-4fd5-adeb-941e204232d6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:12.461854 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abb33416-ea8b-4fd5-adeb-941e204232d6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:12.462287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abb33416-ea8b-4fd5-adeb-941e204232d6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:12.463005 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abb33416-ea8b-4fd5-adeb-941e204232d6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:12.463455 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abb33416-ea8b-4fd5-adeb-941e204232d6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:12.463874 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-abb33416-ea8b-4fd5-adeb-941e204232d6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:12.481430 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e8eb5b49-a327-4a99-bb55-105bb3d211ad tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:12.482414 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e8eb5b49-a327-4a99-bb55-105bb3d211ad tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:12.489416 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8eb5b49-a327-4a99-bb55-105bb3d211ad tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:12.489905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8eb5b49-a327-4a99-bb55-105bb3d211ad tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:12.490342 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8eb5b49-a327-4a99-bb55-105bb3d211ad tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:12.491068 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8eb5b49-a327-4a99-bb55-105bb3d211ad tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:12.491524 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8eb5b49-a327-4a99-bb55-105bb3d211ad tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:12.491951 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e8eb5b49-a327-4a99-bb55-105bb3d211ad tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:12.638145 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-abb33416-ea8b-4fd5-adeb-941e204232d6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:12.646142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-abb33416-ea8b-4fd5-adeb-941e204232d6 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.195699 Aug 30 05:18:12.646724 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 379/789] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:12 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:12.651159 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f24e5fcc-fbbb-47eb-9299-51e124300088 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:12.651753 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f24e5fcc-fbbb-47eb-9299-51e124300088 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:12.669555 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f24e5fcc-fbbb-47eb-9299-51e124300088 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:12.670128 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f24e5fcc-fbbb-47eb-9299-51e124300088 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:12.671098 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f24e5fcc-fbbb-47eb-9299-51e124300088 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:12.671819 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f24e5fcc-fbbb-47eb-9299-51e124300088 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:12.672283 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f24e5fcc-fbbb-47eb-9299-51e124300088 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:12.672714 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f24e5fcc-fbbb-47eb-9299-51e124300088 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:12.685904 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e8eb5b49-a327-4a99-bb55-105bb3d211ad tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:12.693539 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e8eb5b49-a327-4a99-bb55-105bb3d211ad tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.215975 Aug 30 05:18:12.694106 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 411/790] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:12 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:18:12.703173 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f24e5fcc-fbbb-47eb-9299-51e124300088 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:12.703668 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f24e5fcc-fbbb-47eb-9299-51e124300088 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:12.704105 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f24e5fcc-fbbb-47eb-9299-51e124300088 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:12.704550 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-f24e5fcc-fbbb-47eb-9299-51e124300088 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lazy-loading 'fault' on Instance uuid 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:18:12.745816 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f24e5fcc-fbbb-47eb-9299-51e124300088 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:12.754752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f24e5fcc-fbbb-47eb-9299-51e124300088 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1326 microversion: 2.1 time: 0.106988 Aug 30 05:18:12.755683 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 380/791] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:12 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1326 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:13.126564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9f415655-4072-4334-a550-f6cd62371d55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:13.128049 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9f415655-4072-4334-a550-f6cd62371d55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:13.131311 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:13.136336 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f415655-4072-4334-a550-f6cd62371d55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:13.136896 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f415655-4072-4334-a550-f6cd62371d55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:13.137335 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f415655-4072-4334-a550-f6cd62371d55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:13.138049 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f415655-4072-4334-a550-f6cd62371d55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:13.138507 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f415655-4072-4334-a550-f6cd62371d55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:13.139624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f415655-4072-4334-a550-f6cd62371d55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:13.273269 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9f415655-4072-4334-a550-f6cd62371d55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:13.292758 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9f415655-4072-4334-a550-f6cd62371d55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:13.294561 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9f415655-4072-4334-a550-f6cd62371d55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:13.296169 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9f415655-4072-4334-a550-f6cd62371d55 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.176168 Aug 30 05:18:13.297365 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 412/792] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:13 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:13.668517 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1205aa2c-5ee0-4262-ac2a-397273c0047a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:13.669175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1205aa2c-5ee0-4262-ac2a-397273c0047a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:13.676043 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1205aa2c-5ee0-4262-ac2a-397273c0047a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:13.676529 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1205aa2c-5ee0-4262-ac2a-397273c0047a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:13.677080 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1205aa2c-5ee0-4262-ac2a-397273c0047a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:13.677849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1205aa2c-5ee0-4262-ac2a-397273c0047a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:13.678310 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1205aa2c-5ee0-4262-ac2a-397273c0047a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:13.678733 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1205aa2c-5ee0-4262-ac2a-397273c0047a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:13.713885 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ec7b02a7-8bd8-4916-b823-6688bf1e08b1 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:13.714498 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ec7b02a7-8bd8-4916-b823-6688bf1e08b1 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:13.721813 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec7b02a7-8bd8-4916-b823-6688bf1e08b1 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:13.722238 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec7b02a7-8bd8-4916-b823-6688bf1e08b1 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:13.722676 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec7b02a7-8bd8-4916-b823-6688bf1e08b1 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:13.723466 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec7b02a7-8bd8-4916-b823-6688bf1e08b1 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:13.723920 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec7b02a7-8bd8-4916-b823-6688bf1e08b1 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:13.724344 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ec7b02a7-8bd8-4916-b823-6688bf1e08b1 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:13.835101 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1205aa2c-5ee0-4262-ac2a-397273c0047a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:13.842993 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1205aa2c-5ee0-4262-ac2a-397273c0047a tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.178247 Aug 30 05:18:13.843545 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 381/793] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:13 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:13.847876 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4dee07a2-e28c-44e9-8e52-04f7c1277842 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:13.848479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4dee07a2-e28c-44e9-8e52-04f7c1277842 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:13.854137 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4dee07a2-e28c-44e9-8e52-04f7c1277842 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:13.854622 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4dee07a2-e28c-44e9-8e52-04f7c1277842 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:13.855090 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4dee07a2-e28c-44e9-8e52-04f7c1277842 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:13.855780 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4dee07a2-e28c-44e9-8e52-04f7c1277842 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:13.856230 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4dee07a2-e28c-44e9-8e52-04f7c1277842 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:13.856654 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4dee07a2-e28c-44e9-8e52-04f7c1277842 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:13.870211 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ec7b02a7-8bd8-4916-b823-6688bf1e08b1 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:13.878351 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ec7b02a7-8bd8-4916-b823-6688bf1e08b1 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.168575 Aug 30 05:18:13.879113 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 413/794] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:13 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:18:13.889077 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4dee07a2-e28c-44e9-8e52-04f7c1277842 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:13.889628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4dee07a2-e28c-44e9-8e52-04f7c1277842 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:13.890129 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4dee07a2-e28c-44e9-8e52-04f7c1277842 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:13.890637 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-4dee07a2-e28c-44e9-8e52-04f7c1277842 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lazy-loading 'fault' on Instance uuid 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:18:13.933886 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4dee07a2-e28c-44e9-8e52-04f7c1277842 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:13.941428 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4dee07a2-e28c-44e9-8e52-04f7c1277842 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1326 microversion: 2.1 time: 0.096968 Aug 30 05:18:13.941989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 382/795] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:13 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1326 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:14.320737 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4e4c85d9-ed11-4969-8998-6f53f18dbd75 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:14.321588 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4e4c85d9-ed11-4969-8998-6f53f18dbd75 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:14.329091 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e4c85d9-ed11-4969-8998-6f53f18dbd75 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:14.329627 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e4c85d9-ed11-4969-8998-6f53f18dbd75 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:14.330244 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e4c85d9-ed11-4969-8998-6f53f18dbd75 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:14.331268 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e4c85d9-ed11-4969-8998-6f53f18dbd75 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:14.331731 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e4c85d9-ed11-4969-8998-6f53f18dbd75 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:14.332570 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4e4c85d9-ed11-4969-8998-6f53f18dbd75 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:14.472078 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4e4c85d9-ed11-4969-8998-6f53f18dbd75 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:14.480247 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4e4c85d9-ed11-4969-8998-6f53f18dbd75 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:14.481692 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4e4c85d9-ed11-4969-8998-6f53f18dbd75 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:14.482907 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4e4c85d9-ed11-4969-8998-6f53f18dbd75 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.166201 Aug 30 05:18:14.483465 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 414/796] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:14 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:14.864819 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dd441993-e82e-4b1e-8fb6-4d975420d71f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:14.865593 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dd441993-e82e-4b1e-8fb6-4d975420d71f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:14.878314 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd441993-e82e-4b1e-8fb6-4d975420d71f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:14.878805 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd441993-e82e-4b1e-8fb6-4d975420d71f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:14.879261 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd441993-e82e-4b1e-8fb6-4d975420d71f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:14.879967 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd441993-e82e-4b1e-8fb6-4d975420d71f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:14.880420 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd441993-e82e-4b1e-8fb6-4d975420d71f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:14.880841 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd441993-e82e-4b1e-8fb6-4d975420d71f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:14.900431 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2398e600-c611-4014-99ed-7474d26e666c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:14.901198 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2398e600-c611-4014-99ed-7474d26e666c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:14.914383 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2398e600-c611-4014-99ed-7474d26e666c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:14.915279 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2398e600-c611-4014-99ed-7474d26e666c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:14.916057 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2398e600-c611-4014-99ed-7474d26e666c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:14.917267 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2398e600-c611-4014-99ed-7474d26e666c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:14.918087 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2398e600-c611-4014-99ed-7474d26e666c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:14.918912 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2398e600-c611-4014-99ed-7474d26e666c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:15.049950 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dd441993-e82e-4b1e-8fb6-4d975420d71f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:15.057616 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dd441993-e82e-4b1e-8fb6-4d975420d71f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.197821 Aug 30 05:18:15.058196 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 383/797] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:14 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:15.063346 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aef739f1-ba09-48ee-b8eb-f6e2e7c991e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:15.063959 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-aef739f1-ba09-48ee-b8eb-f6e2e7c991e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:15.069609 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aef739f1-ba09-48ee-b8eb-f6e2e7c991e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:15.070101 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aef739f1-ba09-48ee-b8eb-f6e2e7c991e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:15.070546 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aef739f1-ba09-48ee-b8eb-f6e2e7c991e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:15.071270 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aef739f1-ba09-48ee-b8eb-f6e2e7c991e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:15.071733 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aef739f1-ba09-48ee-b8eb-f6e2e7c991e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:15.072161 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aef739f1-ba09-48ee-b8eb-f6e2e7c991e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:15.091804 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2398e600-c611-4014-99ed-7474d26e666c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:15.099351 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2398e600-c611-4014-99ed-7474d26e666c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.204537 Aug 30 05:18:15.099915 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 415/798] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:14 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:15.102739 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aef739f1-ba09-48ee-b8eb-f6e2e7c991e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:15.103259 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aef739f1-ba09-48ee-b8eb-f6e2e7c991e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:15.103698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aef739f1-ba09-48ee-b8eb-f6e2e7c991e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:15.104147 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-aef739f1-ba09-48ee-b8eb-f6e2e7c991e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lazy-loading 'fault' on Instance uuid 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:18:15.144116 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aef739f1-ba09-48ee-b8eb-f6e2e7c991e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:15.152492 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aef739f1-ba09-48ee-b8eb-f6e2e7c991e6 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1326 microversion: 2.1 time: 0.093342 Aug 30 05:18:15.153061 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 384/799] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:15 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1326 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:15.505565 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e41c3d02-3a39-4561-9952-8d83821abb16 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:15.506775 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e41c3d02-3a39-4561-9952-8d83821abb16 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:15.512948 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e41c3d02-3a39-4561-9952-8d83821abb16 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:15.513456 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e41c3d02-3a39-4561-9952-8d83821abb16 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:15.514038 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e41c3d02-3a39-4561-9952-8d83821abb16 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:15.514785 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e41c3d02-3a39-4561-9952-8d83821abb16 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:15.515263 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e41c3d02-3a39-4561-9952-8d83821abb16 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:15.515676 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e41c3d02-3a39-4561-9952-8d83821abb16 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:15.664288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e41c3d02-3a39-4561-9952-8d83821abb16 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:15.672869 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e41c3d02-3a39-4561-9952-8d83821abb16 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:15.674313 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e41c3d02-3a39-4561-9952-8d83821abb16 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:15.675482 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e41c3d02-3a39-4561-9952-8d83821abb16 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.174008 Aug 30 05:18:15.676229 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 416/800] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:15 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 05:18:16.079008 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-609a7748-40b1-4136-91f5-150ae6764df3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:16.079898 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-609a7748-40b1-4136-91f5-150ae6764df3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:16.086797 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-609a7748-40b1-4136-91f5-150ae6764df3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:16.087304 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-609a7748-40b1-4136-91f5-150ae6764df3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:16.087740 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-609a7748-40b1-4136-91f5-150ae6764df3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:16.088434 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-609a7748-40b1-4136-91f5-150ae6764df3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:16.088886 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-609a7748-40b1-4136-91f5-150ae6764df3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:16.089337 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-609a7748-40b1-4136-91f5-150ae6764df3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:16.120810 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-16f7e1dd-f75f-4f8c-9792-2556be4dfb99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:16.121510 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-16f7e1dd-f75f-4f8c-9792-2556be4dfb99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:16.127971 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16f7e1dd-f75f-4f8c-9792-2556be4dfb99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:16.128531 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16f7e1dd-f75f-4f8c-9792-2556be4dfb99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:16.129046 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16f7e1dd-f75f-4f8c-9792-2556be4dfb99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:16.130279 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16f7e1dd-f75f-4f8c-9792-2556be4dfb99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:16.130733 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16f7e1dd-f75f-4f8c-9792-2556be4dfb99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:16.131188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-16f7e1dd-f75f-4f8c-9792-2556be4dfb99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:16.245782 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-609a7748-40b1-4136-91f5-150ae6764df3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:16.255725 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-609a7748-40b1-4136-91f5-150ae6764df3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.180758 Aug 30 05:18:16.256552 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 385/801] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:16 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:16.261810 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0a9540ef-782d-425b-8b3e-b0420ca2a6bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:16.262873 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0a9540ef-782d-425b-8b3e-b0420ca2a6bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:16.269439 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a9540ef-782d-425b-8b3e-b0420ca2a6bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:16.270899 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a9540ef-782d-425b-8b3e-b0420ca2a6bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:16.271554 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a9540ef-782d-425b-8b3e-b0420ca2a6bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:16.272601 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a9540ef-782d-425b-8b3e-b0420ca2a6bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:16.273313 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a9540ef-782d-425b-8b3e-b0420ca2a6bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:16.273430 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-16f7e1dd-f75f-4f8c-9792-2556be4dfb99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:16.274077 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a9540ef-782d-425b-8b3e-b0420ca2a6bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:16.281801 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-16f7e1dd-f75f-4f8c-9792-2556be4dfb99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.164665 Aug 30 05:18:16.282387 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 417/802] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:16 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:18:16.309708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a9540ef-782d-425b-8b3e-b0420ca2a6bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:16.310192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a9540ef-782d-425b-8b3e-b0420ca2a6bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:16.310629 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0a9540ef-782d-425b-8b3e-b0420ca2a6bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:16.311109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-0a9540ef-782d-425b-8b3e-b0420ca2a6bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lazy-loading 'fault' on Instance uuid 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:18:16.351908 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0a9540ef-782d-425b-8b3e-b0420ca2a6bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:16.359425 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0a9540ef-782d-425b-8b3e-b0420ca2a6bd tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1326 microversion: 2.1 time: 0.101361 Aug 30 05:18:16.359988 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 386/803] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:16 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1326 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:16.698650 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a909d149-c27a-4dd8-8027-1ae6e3a46086 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:16.699228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a909d149-c27a-4dd8-8027-1ae6e3a46086 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:16.705089 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a909d149-c27a-4dd8-8027-1ae6e3a46086 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:16.705567 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a909d149-c27a-4dd8-8027-1ae6e3a46086 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:16.706006 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a909d149-c27a-4dd8-8027-1ae6e3a46086 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:16.706684 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a909d149-c27a-4dd8-8027-1ae6e3a46086 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:16.707174 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a909d149-c27a-4dd8-8027-1ae6e3a46086 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:16.707593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a909d149-c27a-4dd8-8027-1ae6e3a46086 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:16.849875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a909d149-c27a-4dd8-8027-1ae6e3a46086 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:16.858168 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a909d149-c27a-4dd8-8027-1ae6e3a46086 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:16.859620 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a909d149-c27a-4dd8-8027-1ae6e3a46086 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:16.860809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a909d149-c27a-4dd8-8027-1ae6e3a46086 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.166113 Aug 30 05:18:16.861367 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 418/804] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:16 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:17.276227 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b26806fe-533d-462d-85e9-c0fdf105d1d4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:17.286149 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b26806fe-533d-462d-85e9-c0fdf105d1d4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:17.289250 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b26806fe-533d-462d-85e9-c0fdf105d1d4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:17.289759 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b26806fe-533d-462d-85e9-c0fdf105d1d4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:17.290259 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b26806fe-533d-462d-85e9-c0fdf105d1d4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:17.295120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b26806fe-533d-462d-85e9-c0fdf105d1d4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:17.295952 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b26806fe-533d-462d-85e9-c0fdf105d1d4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:17.296751 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b26806fe-533d-462d-85e9-c0fdf105d1d4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:17.302852 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2242b55e-8f7f-4472-b9e5-7d070a07baed tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:17.303296 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2242b55e-8f7f-4472-b9e5-7d070a07baed tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:17.322350 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2242b55e-8f7f-4472-b9e5-7d070a07baed tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:17.322863 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2242b55e-8f7f-4472-b9e5-7d070a07baed tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:17.323311 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2242b55e-8f7f-4472-b9e5-7d070a07baed tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:17.324021 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2242b55e-8f7f-4472-b9e5-7d070a07baed tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:17.324478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2242b55e-8f7f-4472-b9e5-7d070a07baed tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:17.324902 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2242b55e-8f7f-4472-b9e5-7d070a07baed tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:17.442938 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b26806fe-533d-462d-85e9-c0fdf105d1d4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:17.450571 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b26806fe-533d-462d-85e9-c0fdf105d1d4 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.178370 Aug 30 05:18:17.451175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 387/805] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:17 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:17.455725 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e610dbf2-dc2e-4bea-be1c-37c374733639 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:17.456465 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e610dbf2-dc2e-4bea-be1c-37c374733639 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:17.463496 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e610dbf2-dc2e-4bea-be1c-37c374733639 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:17.463996 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e610dbf2-dc2e-4bea-be1c-37c374733639 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:17.464147 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2242b55e-8f7f-4472-b9e5-7d070a07baed tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:17.464435 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e610dbf2-dc2e-4bea-be1c-37c374733639 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:17.465138 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e610dbf2-dc2e-4bea-be1c-37c374733639 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:17.467964 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e610dbf2-dc2e-4bea-be1c-37c374733639 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:17.468069 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e610dbf2-dc2e-4bea-be1c-37c374733639 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:17.472343 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2242b55e-8f7f-4472-b9e5-7d070a07baed tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.173510 Aug 30 05:18:17.473046 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 419/806] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:17 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:17.499187 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e610dbf2-dc2e-4bea-be1c-37c374733639 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:17.499707 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e610dbf2-dc2e-4bea-be1c-37c374733639 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:17.500148 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e610dbf2-dc2e-4bea-be1c-37c374733639 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:17.500596 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-e610dbf2-dc2e-4bea-be1c-37c374733639 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lazy-loading 'fault' on Instance uuid 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:18:17.544339 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e610dbf2-dc2e-4bea-be1c-37c374733639 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:17.551966 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e610dbf2-dc2e-4bea-be1c-37c374733639 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1326 microversion: 2.1 time: 0.099859 Aug 30 05:18:17.552530 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 388/807] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:17 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:17.884103 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-465739c9-a700-4406-ab83-db0e00f5828d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:17.884724 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-465739c9-a700-4406-ab83-db0e00f5828d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:17.890911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-465739c9-a700-4406-ab83-db0e00f5828d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:17.891406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-465739c9-a700-4406-ab83-db0e00f5828d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:17.891848 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-465739c9-a700-4406-ab83-db0e00f5828d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:17.892545 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-465739c9-a700-4406-ab83-db0e00f5828d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:17.893001 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-465739c9-a700-4406-ab83-db0e00f5828d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:17.893427 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-465739c9-a700-4406-ab83-db0e00f5828d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:18.040930 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-465739c9-a700-4406-ab83-db0e00f5828d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:18.049020 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-465739c9-a700-4406-ab83-db0e00f5828d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:18.050483 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-465739c9-a700-4406-ab83-db0e00f5828d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:18.051700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-465739c9-a700-4406-ab83-db0e00f5828d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.171544 Aug 30 05:18:18.066761 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 420/808] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:17 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:18.471921 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-26dc8441-33d4-47f9-8fb3-fecb56c27715 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:18.472535 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-26dc8441-33d4-47f9-8fb3-fecb56c27715 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:18.479344 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26dc8441-33d4-47f9-8fb3-fecb56c27715 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:18.479823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26dc8441-33d4-47f9-8fb3-fecb56c27715 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:18.480254 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26dc8441-33d4-47f9-8fb3-fecb56c27715 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:18.480935 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26dc8441-33d4-47f9-8fb3-fecb56c27715 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:18.481409 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26dc8441-33d4-47f9-8fb3-fecb56c27715 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:18.481829 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-26dc8441-33d4-47f9-8fb3-fecb56c27715 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:18.493835 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7150b6b6-c162-4571-8564-b640503bc30e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:18.494445 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7150b6b6-c162-4571-8564-b640503bc30e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:18.500702 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7150b6b6-c162-4571-8564-b640503bc30e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:18.501187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7150b6b6-c162-4571-8564-b640503bc30e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:18.501623 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7150b6b6-c162-4571-8564-b640503bc30e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:18.502395 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7150b6b6-c162-4571-8564-b640503bc30e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:18.502846 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7150b6b6-c162-4571-8564-b640503bc30e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:18.503280 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7150b6b6-c162-4571-8564-b640503bc30e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:18.613766 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-26dc8441-33d4-47f9-8fb3-fecb56c27715 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:18.621763 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-26dc8441-33d4-47f9-8fb3-fecb56c27715 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.153709 Aug 30 05:18:18.622352 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 389/809] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:18 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:18:18.626778 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e61b04e6-0457-4687-92b9-4bc6c313fa4b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:18.627409 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e61b04e6-0457-4687-92b9-4bc6c313fa4b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:18.631846 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-7150b6b6-c162-4571-8564-b640503bc30e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:18.633059 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e61b04e6-0457-4687-92b9-4bc6c313fa4b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:18.633552 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e61b04e6-0457-4687-92b9-4bc6c313fa4b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:18.633982 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e61b04e6-0457-4687-92b9-4bc6c313fa4b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:18.634672 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e61b04e6-0457-4687-92b9-4bc6c313fa4b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:18.635151 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e61b04e6-0457-4687-92b9-4bc6c313fa4b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:18.635579 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e61b04e6-0457-4687-92b9-4bc6c313fa4b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:18.637395 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=100 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:18.640149 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7150b6b6-c162-4571-8564-b640503bc30e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.150677 Aug 30 05:18:18.640723 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 421/810] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:18 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:18:18.666615 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e61b04e6-0457-4687-92b9-4bc6c313fa4b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:18.667120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e61b04e6-0457-4687-92b9-4bc6c313fa4b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:18.667561 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e61b04e6-0457-4687-92b9-4bc6c313fa4b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:18.667999 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-e61b04e6-0457-4687-92b9-4bc6c313fa4b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lazy-loading 'fault' on Instance uuid 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:18:18.708343 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e61b04e6-0457-4687-92b9-4bc6c313fa4b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:18.727188 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e61b04e6-0457-4687-92b9-4bc6c313fa4b tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1326 microversion: 2.1 time: 0.103651 Aug 30 05:18:18.728048 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 390/811] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:18 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1326 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:19.074908 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-baec2b28-d092-4099-862e-a06c61e8961c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:19.075514 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-baec2b28-d092-4099-862e-a06c61e8961c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:19.081394 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-baec2b28-d092-4099-862e-a06c61e8961c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:19.081872 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-baec2b28-d092-4099-862e-a06c61e8961c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:19.082305 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-baec2b28-d092-4099-862e-a06c61e8961c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:19.083023 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-baec2b28-d092-4099-862e-a06c61e8961c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:19.083465 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-baec2b28-d092-4099-862e-a06c61e8961c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:19.083885 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-baec2b28-d092-4099-862e-a06c61e8961c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:19.212574 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-baec2b28-d092-4099-862e-a06c61e8961c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:19.221073 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-baec2b28-d092-4099-862e-a06c61e8961c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:19.222543 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-baec2b28-d092-4099-862e-a06c61e8961c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:19.223718 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-baec2b28-d092-4099-862e-a06c61e8961c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.153099 Aug 30 05:18:19.224282 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 422/812] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:19 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:19.642367 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-436f99d3-a0f6-48c4-9147-5e83220e35aa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:19.643017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-436f99d3-a0f6-48c4-9147-5e83220e35aa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:19.649899 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-436f99d3-a0f6-48c4-9147-5e83220e35aa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:19.650381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-436f99d3-a0f6-48c4-9147-5e83220e35aa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:19.650841 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-436f99d3-a0f6-48c4-9147-5e83220e35aa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:19.651530 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-436f99d3-a0f6-48c4-9147-5e83220e35aa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:19.651979 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-436f99d3-a0f6-48c4-9147-5e83220e35aa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:19.652399 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-436f99d3-a0f6-48c4-9147-5e83220e35aa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:19.660679 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9f97b999-a9b4-437d-8247-75df18e50285 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:19.661300 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9f97b999-a9b4-437d-8247-75df18e50285 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:19.668471 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f97b999-a9b4-437d-8247-75df18e50285 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:19.668958 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f97b999-a9b4-437d-8247-75df18e50285 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:19.669398 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f97b999-a9b4-437d-8247-75df18e50285 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:19.670097 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f97b999-a9b4-437d-8247-75df18e50285 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:19.670559 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f97b999-a9b4-437d-8247-75df18e50285 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:19.671025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9f97b999-a9b4-437d-8247-75df18e50285 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:19.790206 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-436f99d3-a0f6-48c4-9147-5e83220e35aa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:19.792390 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:19.798866 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-436f99d3-a0f6-48c4-9147-5e83220e35aa tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.160272 Aug 30 05:18:19.799440 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 391/813] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:19 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:19.804110 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fa56af23-d76c-45ca-95f5-efbaa561512e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:19.804810 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fa56af23-d76c-45ca-95f5-efbaa561512e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:19.807819 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9f97b999-a9b4-437d-8247-75df18e50285 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:19.810473 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa56af23-d76c-45ca-95f5-efbaa561512e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:19.811000 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa56af23-d76c-45ca-95f5-efbaa561512e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:19.811693 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa56af23-d76c-45ca-95f5-efbaa561512e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:19.812118 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa56af23-d76c-45ca-95f5-efbaa561512e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:19.812571 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa56af23-d76c-45ca-95f5-efbaa561512e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:19.812992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa56af23-d76c-45ca-95f5-efbaa561512e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:19.815811 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9f97b999-a9b4-437d-8247-75df18e50285 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.158909 Aug 30 05:18:19.816381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 423/814] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:19 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:18:19.844097 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa56af23-d76c-45ca-95f5-efbaa561512e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:19.844579 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa56af23-d76c-45ca-95f5-efbaa561512e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:19.845011 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fa56af23-d76c-45ca-95f5-efbaa561512e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:19.845452 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-fa56af23-d76c-45ca-95f5-efbaa561512e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lazy-loading 'fault' on Instance uuid 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:18:19.885895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-fa56af23-d76c-45ca-95f5-efbaa561512e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:19.893803 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fa56af23-d76c-45ca-95f5-efbaa561512e tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1326 microversion: 2.1 time: 0.093310 Aug 30 05:18:19.894301 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 392/815] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:19 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1326 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:20.248151 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-437f9bed-b2f8-48ed-98f1-fab947063668 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:20.248688 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-437f9bed-b2f8-48ed-98f1-fab947063668 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:20.254685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-437f9bed-b2f8-48ed-98f1-fab947063668 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:20.255211 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-437f9bed-b2f8-48ed-98f1-fab947063668 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:20.256296 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-437f9bed-b2f8-48ed-98f1-fab947063668 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:20.256988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-437f9bed-b2f8-48ed-98f1-fab947063668 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:20.257442 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-437f9bed-b2f8-48ed-98f1-fab947063668 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:20.257868 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-437f9bed-b2f8-48ed-98f1-fab947063668 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:20.386694 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-437f9bed-b2f8-48ed-98f1-fab947063668 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:20.394671 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-437f9bed-b2f8-48ed-98f1-fab947063668 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:20.396137 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-437f9bed-b2f8-48ed-98f1-fab947063668 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:20.397344 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-437f9bed-b2f8-48ed-98f1-fab947063668 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.153176 Aug 30 05:18:20.397930 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 424/816] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:20 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:20.819301 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ac4a9126-6318-41ad-9fec-dabced59701e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:20.819909 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ac4a9126-6318-41ad-9fec-dabced59701e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:20.826238 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac4a9126-6318-41ad-9fec-dabced59701e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:20.826715 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac4a9126-6318-41ad-9fec-dabced59701e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:20.827175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac4a9126-6318-41ad-9fec-dabced59701e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:20.827857 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac4a9126-6318-41ad-9fec-dabced59701e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:20.828306 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac4a9126-6318-41ad-9fec-dabced59701e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:20.828725 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ac4a9126-6318-41ad-9fec-dabced59701e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:20.836322 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ad11f648-65c7-4f53-b355-3db52570c0b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:20.836930 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ad11f648-65c7-4f53-b355-3db52570c0b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:20.843450 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad11f648-65c7-4f53-b355-3db52570c0b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:20.843933 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad11f648-65c7-4f53-b355-3db52570c0b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:20.844366 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad11f648-65c7-4f53-b355-3db52570c0b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:20.845050 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad11f648-65c7-4f53-b355-3db52570c0b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:20.845504 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad11f648-65c7-4f53-b355-3db52570c0b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:20.845923 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad11f648-65c7-4f53-b355-3db52570c0b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:20.961073 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ac4a9126-6318-41ad-9fec-dabced59701e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:20.971605 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ac4a9126-6318-41ad-9fec-dabced59701e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.156094 Aug 30 05:18:20.972194 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 393/817] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:20 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:20.977288 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1cb49137-d9eb-42e4-b59e-1846bf75213a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:20.977895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1cb49137-d9eb-42e4-b59e-1846bf75213a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:20.978997 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ad11f648-65c7-4f53-b355-3db52570c0b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:20.983728 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cb49137-d9eb-42e4-b59e-1846bf75213a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:20.984212 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cb49137-d9eb-42e4-b59e-1846bf75213a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:20.984647 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cb49137-d9eb-42e4-b59e-1846bf75213a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:20.985338 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cb49137-d9eb-42e4-b59e-1846bf75213a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:20.985788 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cb49137-d9eb-42e4-b59e-1846bf75213a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:20.986211 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cb49137-d9eb-42e4-b59e-1846bf75213a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:20.987416 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ad11f648-65c7-4f53-b355-3db52570c0b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.155405 Aug 30 05:18:20.988015 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 425/818] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:20 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:21.017559 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cb49137-d9eb-42e4-b59e-1846bf75213a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:21.018045 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cb49137-d9eb-42e4-b59e-1846bf75213a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:21.018501 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cb49137-d9eb-42e4-b59e-1846bf75213a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:21.018978 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-1cb49137-d9eb-42e4-b59e-1846bf75213a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lazy-loading 'fault' on Instance uuid 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:18:21.061757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1cb49137-d9eb-42e4-b59e-1846bf75213a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8f01d0042c84767899dc2b71bca4e12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '116fb506b7794c1fa9460b5a861de136', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:21.070007 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1cb49137-d9eb-42e4-b59e-1846bf75213a tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 200 len: 1326 microversion: 2.1 time: 0.096825 Aug 30 05:18:21.070519 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 394/819] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:20 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 1326 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:21.419150 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-57cc1b0d-58f2-4d16-8ab6-267bc659a2c9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:21.419681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-57cc1b0d-58f2-4d16-8ab6-267bc659a2c9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:21.425624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57cc1b0d-58f2-4d16-8ab6-267bc659a2c9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:21.426097 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57cc1b0d-58f2-4d16-8ab6-267bc659a2c9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:21.426527 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57cc1b0d-58f2-4d16-8ab6-267bc659a2c9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:21.427250 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57cc1b0d-58f2-4d16-8ab6-267bc659a2c9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:21.428354 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57cc1b0d-58f2-4d16-8ab6-267bc659a2c9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:21.428705 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57cc1b0d-58f2-4d16-8ab6-267bc659a2c9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:21.581772 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-57cc1b0d-58f2-4d16-8ab6-267bc659a2c9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:21.590141 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-57cc1b0d-58f2-4d16-8ab6-267bc659a2c9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:21.591894 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-57cc1b0d-58f2-4d16-8ab6-267bc659a2c9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:21.593038 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-57cc1b0d-58f2-4d16-8ab6-267bc659a2c9 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.177927 Aug 30 05:18:21.593586 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 426/820] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:21 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:21.993298 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8163c69d-4f23-47ac-8321-eaeee31f530f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:21.993965 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8163c69d-4f23-47ac-8321-eaeee31f530f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:22.000324 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8163c69d-4f23-47ac-8321-eaeee31f530f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:22.000812 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8163c69d-4f23-47ac-8321-eaeee31f530f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:22.001243 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8163c69d-4f23-47ac-8321-eaeee31f530f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:22.001967 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8163c69d-4f23-47ac-8321-eaeee31f530f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:22.002530 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8163c69d-4f23-47ac-8321-eaeee31f530f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:22.002987 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8163c69d-4f23-47ac-8321-eaeee31f530f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:22.008477 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e19d6afc-f4a8-4377-bbfd-9004dd765f88 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:22.009366 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e19d6afc-f4a8-4377-bbfd-9004dd765f88 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:22.016317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e19d6afc-f4a8-4377-bbfd-9004dd765f88 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:22.017221 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e19d6afc-f4a8-4377-bbfd-9004dd765f88 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:22.017896 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e19d6afc-f4a8-4377-bbfd-9004dd765f88 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:22.018834 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e19d6afc-f4a8-4377-bbfd-9004dd765f88 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:22.019497 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e19d6afc-f4a8-4377-bbfd-9004dd765f88 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:22.020259 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e19d6afc-f4a8-4377-bbfd-9004dd765f88 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:22.138116 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8163c69d-4f23-47ac-8321-eaeee31f530f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:22.145761 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8163c69d-4f23-47ac-8321-eaeee31f530f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.156932 Aug 30 05:18:22.146322 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 395/821] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:21 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:22.150762 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6b2af530-b06b-4136-85c9-bb2f5f7578ae tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:22.151392 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6b2af530-b06b-4136-85c9-bb2f5f7578ae tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:22.152915 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e19d6afc-f4a8-4377-bbfd-9004dd765f88 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:22.157105 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b2af530-b06b-4136-85c9-bb2f5f7578ae tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:22.157585 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b2af530-b06b-4136-85c9-bb2f5f7578ae tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:22.158019 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b2af530-b06b-4136-85c9-bb2f5f7578ae tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:22.158709 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b2af530-b06b-4136-85c9-bb2f5f7578ae tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:22.159196 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b2af530-b06b-4136-85c9-bb2f5f7578ae tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:22.159686 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6b2af530-b06b-4136-85c9-bb2f5f7578ae tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:22.161612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e19d6afc-f4a8-4377-bbfd-9004dd765f88 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1366 microversion: 2.1 time: 0.156968 Aug 30 05:18:22.163067 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 427/822] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:22 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:22.173761 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-6b2af530-b06b-4136-85c9-bb2f5f7578ae tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] HTTP exception thrown: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6b2af530-b06b-4136-85c9-bb2f5f7578ae tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Request method failure captured: Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 HTTP/1.1 Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZwiTTjIdFLzbpKGGpVA3DA-wQMC11XCY2BH6iqM7GBty3a3ccClw13LpIkL82s1_zUTcGUl6Fxcxen95MvsmbIMvoGt9q6XWYGOnL0LH9Um7BPa8yeMLK-bSKBoqaJjPxzTDkf7rQc9Wiq858Zw38xN0TvFDFaisonA92G3wQeNg1c Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: 116fb506b7794c1fa9460b5a861de136 Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:18:22.175450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:18:22.177063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_116fb506b7794c1fa9460b5a861de136", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:18:22.177063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:18:22.177063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 116fb506b7794c1fa9460b5a861de136 Aug 30 05:18:22.177063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:18:22.177063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeTestJSON-1134370107-project Aug 30 05:18:22.177063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:18:22.177063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:18:22.177063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: a8f01d0042c84767899dc2b71bca4e12 Aug 30 05:18:22.177063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeTestJSON-1134370107-project Aug 30 05:18:22.177063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:18:22.177063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. Aug 30 05:18:22.177063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': '0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4'} Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:18:22.178698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. Aug 30 05:18:22.180252 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:22.181673 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6b2af530-b06b-4136-85c9-bb2f5f7578ae tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Returning 404 to user: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:18:22.181673 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6b2af530-b06b-4136-85c9-bb2f5f7578ae tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 404 len: 111 microversion: 2.1 time: 0.029588 Aug 30 05:18:22.181673 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 396/823] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:22 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:18:22.186513 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d5882e54-2c96-4a52-889d-d2c1796b6487 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '.version_select at 0x7f822ed97310>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:22.204686 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d5882e54-2c96-4a52-889d-d2c1796b6487 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-606295863" status: 202 len: 0 microversion: 2.1 time: 0.021923 Aug 30 05:18:22.205240 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 428/824] 10.222.0.77 () {58 vars in 1218 bytes} [Tue Aug 30 05:18:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-606295863 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:18:22.615998 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-19bed226-414c-4ace-a411-486bd61b4aca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:22.616607 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-19bed226-414c-4ace-a411-486bd61b4aca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:22.622467 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19bed226-414c-4ace-a411-486bd61b4aca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:22.623004 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19bed226-414c-4ace-a411-486bd61b4aca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:22.623438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19bed226-414c-4ace-a411-486bd61b4aca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:22.624127 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19bed226-414c-4ace-a411-486bd61b4aca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:22.624574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19bed226-414c-4ace-a411-486bd61b4aca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:22.624996 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-19bed226-414c-4ace-a411-486bd61b4aca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:22.848074 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-19bed226-414c-4ace-a411-486bd61b4aca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:22.856094 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-19bed226-414c-4ace-a411-486bd61b4aca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:22.857523 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-19bed226-414c-4ace-a411-486bd61b4aca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:22.858684 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-19bed226-414c-4ace-a411-486bd61b4aca tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.246636 Aug 30 05:18:22.859337 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 397/825] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:22 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:23.166190 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-428d62aa-0f52-4492-b317-b8f6c95983b9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:23.167353 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-428d62aa-0f52-4492-b317-b8f6c95983b9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:23.173879 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-428d62aa-0f52-4492-b317-b8f6c95983b9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:23.174580 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-428d62aa-0f52-4492-b317-b8f6c95983b9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:23.175139 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-428d62aa-0f52-4492-b317-b8f6c95983b9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:23.175859 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-428d62aa-0f52-4492-b317-b8f6c95983b9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:23.176312 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-428d62aa-0f52-4492-b317-b8f6c95983b9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:23.176738 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-428d62aa-0f52-4492-b317-b8f6c95983b9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:23.182997 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a636cb4a-abce-4a87-bed3-a429307d78b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:23.183625 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a636cb4a-abce-4a87-bed3-a429307d78b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:23.189772 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a636cb4a-abce-4a87-bed3-a429307d78b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:23.190256 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a636cb4a-abce-4a87-bed3-a429307d78b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:23.190688 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a636cb4a-abce-4a87-bed3-a429307d78b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:23.191412 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a636cb4a-abce-4a87-bed3-a429307d78b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:23.191874 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a636cb4a-abce-4a87-bed3-a429307d78b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:23.192301 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a636cb4a-abce-4a87-bed3-a429307d78b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:23.309932 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-428d62aa-0f52-4492-b317-b8f6c95983b9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:23.317543 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-428d62aa-0f52-4492-b317-b8f6c95983b9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.155875 Aug 30 05:18:23.318147 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 429/826] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:23 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:23.324050 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a636cb4a-abce-4a87-bed3-a429307d78b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:23.331886 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a636cb4a-abce-4a87-bed3-a429307d78b2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1556 microversion: 2.1 time: 0.152741 Aug 30 05:18:23.332442 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 398/827] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:23 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:18:23.352981 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d771da6e-8de5-4eec-abcf-a74cd3f5bcd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:23.353505 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d771da6e-8de5-4eec-abcf-a74cd3f5bcd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:23.359514 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d771da6e-8de5-4eec-abcf-a74cd3f5bcd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:23.360002 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d771da6e-8de5-4eec-abcf-a74cd3f5bcd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:23.360463 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d771da6e-8de5-4eec-abcf-a74cd3f5bcd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:23.361155 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d771da6e-8de5-4eec-abcf-a74cd3f5bcd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:23.361610 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d771da6e-8de5-4eec-abcf-a74cd3f5bcd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:23.362039 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d771da6e-8de5-4eec-abcf-a74cd3f5bcd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:23.436440 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d771da6e-8de5-4eec-abcf-a74cd3f5bcd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087867 Aug 30 05:18:23.437039 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 430/828] 10.222.0.77 () {58 vars in 1275 bytes} [Tue Aug 30 05:18:23 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:23.882404 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0ee5d2ff-5484-42ad-a63b-3d0a1b32b3e3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:23.883108 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0ee5d2ff-5484-42ad-a63b-3d0a1b32b3e3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:23.889545 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ee5d2ff-5484-42ad-a63b-3d0a1b32b3e3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:23.890277 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ee5d2ff-5484-42ad-a63b-3d0a1b32b3e3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:23.890928 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ee5d2ff-5484-42ad-a63b-3d0a1b32b3e3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:23.892055 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ee5d2ff-5484-42ad-a63b-3d0a1b32b3e3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:23.892572 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ee5d2ff-5484-42ad-a63b-3d0a1b32b3e3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:23.893003 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0ee5d2ff-5484-42ad-a63b-3d0a1b32b3e3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:24.006162 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-5f0823df-f3bb-4b87-a50b-06a44ef9bd8e req-dbc889b8-56c1-4d40-9b80-4d500c5c3ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23b1f7be-c451-470d-8117-4dd0164f568b", "name": "network-vif-plugged", "status": "completed", "tag": "33dc5fe2-b49b-46cd-bbea-d50e70e21301"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:18:24.016059 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-5f0823df-f3bb-4b87-a50b-06a44ef9bd8e req-dbc889b8-56c1-4d40-9b80-4d500c5c3ccf service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:24.016826 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-5f0823df-f3bb-4b87-a50b-06a44ef9bd8e req-dbc889b8-56c1-4d40-9b80-4d500c5c3ccf service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:24.017671 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-5f0823df-f3bb-4b87-a50b-06a44ef9bd8e req-dbc889b8-56c1-4d40-9b80-4d500c5c3ccf service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:24.036082 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-5f0823df-f3bb-4b87-a50b-06a44ef9bd8e req-dbc889b8-56c1-4d40-9b80-4d500c5c3ccf service nova] Creating event network-vif-plugged:33dc5fe2-b49b-46cd-bbea-d50e70e21301 for instance 23b1f7be-c451-470d-8117-4dd0164f568b on hv-cinder-85391 Aug 30 05:18:24.044358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-5f0823df-f3bb-4b87-a50b-06a44ef9bd8e req-dbc889b8-56c1-4d40-9b80-4d500c5c3ccf service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043068 Aug 30 05:18:24.046142 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 431/829] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:24.060309 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0ee5d2ff-5484-42ad-a63b-3d0a1b32b3e3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:24.074396 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0ee5d2ff-5484-42ad-a63b-3d0a1b32b3e3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:24.075873 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0ee5d2ff-5484-42ad-a63b-3d0a1b32b3e3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:24.077048 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0ee5d2ff-5484-42ad-a63b-3d0a1b32b3e3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.199092 Aug 30 05:18:24.077614 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 399/830] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:23 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:24.340007 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6e83bb9d-6c9a-460e-a1d3-af33e750a24d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:24.341654 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6e83bb9d-6c9a-460e-a1d3-af33e750a24d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:24.350659 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e83bb9d-6c9a-460e-a1d3-af33e750a24d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:24.351157 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e83bb9d-6c9a-460e-a1d3-af33e750a24d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:24.351535 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e83bb9d-6c9a-460e-a1d3-af33e750a24d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:24.352496 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e83bb9d-6c9a-460e-a1d3-af33e750a24d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:24.353183 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e83bb9d-6c9a-460e-a1d3-af33e750a24d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:24.353610 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6e83bb9d-6c9a-460e-a1d3-af33e750a24d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:24.584315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-37ea26f7-932b-4fdc-8d44-dc50351e6900 req-5b681b36-3406-4d22-92f7-74860af09a1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd7486a8-b5d7-45e0-921a-6621d9a10233", "tag": "aa613a15-0a05-4d3e-be80-89172048cffe"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:18:24.587358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6e83bb9d-6c9a-460e-a1d3-af33e750a24d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:24.594794 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-37ea26f7-932b-4fdc-8d44-dc50351e6900 req-5b681b36-3406-4d22-92f7-74860af09a1a service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:24.595305 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-37ea26f7-932b-4fdc-8d44-dc50351e6900 req-5b681b36-3406-4d22-92f7-74860af09a1a service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:24.595742 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-37ea26f7-932b-4fdc-8d44-dc50351e6900 req-5b681b36-3406-4d22-92f7-74860af09a1a service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:24.595948 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6e83bb9d-6c9a-460e-a1d3-af33e750a24d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.260513 Aug 30 05:18:24.596707 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 432/831] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:24 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:24.607801 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-37ea26f7-932b-4fdc-8d44-dc50351e6900 req-5b681b36-3406-4d22-92f7-74860af09a1a service nova] Creating event network-changed:aa613a15-0a05-4d3e-be80-89172048cffe for instance cd7486a8-b5d7-45e0-921a-6621d9a10233 on hv-cinder-85391 Aug 30 05:18:24.612980 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-37ea26f7-932b-4fdc-8d44-dc50351e6900 req-5b681b36-3406-4d22-92f7-74860af09a1a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033103 Aug 30 05:18:24.613570 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 400/832] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:25.099875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ad082912-363b-4587-8c38-3586fd581fa0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:25.100433 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ad082912-363b-4587-8c38-3586fd581fa0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:25.106222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad082912-363b-4587-8c38-3586fd581fa0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:25.106699 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad082912-363b-4587-8c38-3586fd581fa0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:25.107161 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad082912-363b-4587-8c38-3586fd581fa0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:25.107878 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad082912-363b-4587-8c38-3586fd581fa0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:25.108325 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad082912-363b-4587-8c38-3586fd581fa0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:25.108746 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ad082912-363b-4587-8c38-3586fd581fa0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:25.204752 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8925fa03-59a1-4977-b133-377936d72024 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:25.205334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8925fa03-59a1-4977-b133-377936d72024 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:25.211276 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8925fa03-59a1-4977-b133-377936d72024 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:25.211763 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8925fa03-59a1-4977-b133-377936d72024 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:25.212197 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8925fa03-59a1-4977-b133-377936d72024 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:25.212895 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8925fa03-59a1-4977-b133-377936d72024 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:25.213351 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8925fa03-59a1-4977-b133-377936d72024 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:25.214015 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8925fa03-59a1-4977-b133-377936d72024 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:25.228721 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-8925fa03-59a1-4977-b133-377936d72024 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] HTTP exception thrown: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8925fa03-59a1-4977-b133-377936d72024 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Request method failure captured: Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 HTTP/1.1 Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZwiTTjIdFLzbpKGGpVA3DA-wQMC11XCY2BH6iqM7GBty3a3ccClw13LpIkL82s1_zUTcGUl6Fxcxen95MvsmbIMvoGt9q6XWYGOnL0LH9Um7BPa8yeMLK-bSKBoqaJjPxzTDkf7rQc9Wiq858Zw38xN0TvFDFaisonA92G3wQeNg1c Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: 116fb506b7794c1fa9460b5a861de136 Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:18:25.231253 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:18:25.232598 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_116fb506b7794c1fa9460b5a861de136", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:18:25.232598 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:18:25.232598 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 116fb506b7794c1fa9460b5a861de136 Aug 30 05:18:25.232598 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:18:25.232598 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeTestJSON-1134370107-project Aug 30 05:18:25.232598 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:18:25.232598 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:18:25.232598 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: a8f01d0042c84767899dc2b71bca4e12 Aug 30 05:18:25.232598 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeTestJSON-1134370107-project Aug 30 05:18:25.232598 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:18:25.232598 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. Aug 30 05:18:25.232598 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': '0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4'} Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:18:25.233633 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. Aug 30 05:18:25.234802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:25.236127 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8925fa03-59a1-4977-b133-377936d72024 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Returning 404 to user: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:18:25.236127 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8925fa03-59a1-4977-b133-377936d72024 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "DELETE /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 404 len: 111 microversion: 2.1 time: 0.032405 Aug 30 05:18:25.236127 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 401/833] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:18:25 2022] DELETE /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:18:25.250713 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7f851f1d-f9c8-4e95-958d-dfe0ba52f3b2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:25.251571 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7f851f1d-f9c8-4e95-958d-dfe0ba52f3b2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:25.257837 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f851f1d-f9c8-4e95-958d-dfe0ba52f3b2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:25.258447 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f851f1d-f9c8-4e95-958d-dfe0ba52f3b2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:25.259027 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f851f1d-f9c8-4e95-958d-dfe0ba52f3b2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:25.259827 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f851f1d-f9c8-4e95-958d-dfe0ba52f3b2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:25.260405 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f851f1d-f9c8-4e95-958d-dfe0ba52f3b2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:25.261050 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7f851f1d-f9c8-4e95-958d-dfe0ba52f3b2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:25.278662 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-7f851f1d-f9c8-4e95-958d-dfe0ba52f3b2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] HTTP exception thrown: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7f851f1d-f9c8-4e95-958d-dfe0ba52f3b2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Request method failure captured: Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 HTTP/1.1 Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZwiTTjIdFLzbpKGGpVA3DA-wQMC11XCY2BH6iqM7GBty3a3ccClw13LpIkL82s1_zUTcGUl6Fxcxen95MvsmbIMvoGt9q6XWYGOnL0LH9Um7BPa8yeMLK-bSKBoqaJjPxzTDkf7rQc9Wiq858Zw38xN0TvFDFaisonA92G3wQeNg1c Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: 116fb506b7794c1fa9460b5a861de136 Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:18:25.280381 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:18:25.281953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_116fb506b7794c1fa9460b5a861de136", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:18:25.281953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:18:25.281953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 116fb506b7794c1fa9460b5a861de136 Aug 30 05:18:25.281953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:18:25.281953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeTestJSON-1134370107-project Aug 30 05:18:25.281953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:18:25.281953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:18:25.281953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: a8f01d0042c84767899dc2b71bca4e12 Aug 30 05:18:25.281953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeTestJSON-1134370107-project Aug 30 05:18:25.281953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:18:25.281953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. Aug 30 05:18:25.281953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': '0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4'} Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:18:25.282846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. Aug 30 05:18:25.284286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:25.285528 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7f851f1d-f9c8-4e95-958d-dfe0ba52f3b2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Returning 404 to user: Instance 0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:18:25.286452 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7f851f1d-f9c8-4e95-958d-dfe0ba52f3b2 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4" status: 404 len: 111 microversion: 2.1 time: 0.041516 Aug 30 05:18:25.291491 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 402/834] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:25 2022] GET /compute/v2.1/servers/0ca00e76-a4e4-4ba5-909b-aa0a6616a4d4 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:18:25.314651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ad082912-363b-4587-8c38-3586fd581fa0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:25.324223 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ad082912-363b-4587-8c38-3586fd581fa0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:25.325691 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ad082912-363b-4587-8c38-3586fd581fa0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:25.327062 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ad082912-363b-4587-8c38-3586fd581fa0 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.231453 Aug 30 05:18:25.327628 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 433/835] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:25 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:25.618251 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-14681bb0-80a8-4616-9b57-f1b5ba2bd84e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:25.618954 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-14681bb0-80a8-4616-9b57-f1b5ba2bd84e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:25.625071 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14681bb0-80a8-4616-9b57-f1b5ba2bd84e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:25.625562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14681bb0-80a8-4616-9b57-f1b5ba2bd84e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:25.625998 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14681bb0-80a8-4616-9b57-f1b5ba2bd84e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:25.626703 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14681bb0-80a8-4616-9b57-f1b5ba2bd84e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:25.627261 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14681bb0-80a8-4616-9b57-f1b5ba2bd84e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:25.627690 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14681bb0-80a8-4616-9b57-f1b5ba2bd84e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:25.762294 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-14681bb0-80a8-4616-9b57-f1b5ba2bd84e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:25.769986 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-14681bb0-80a8-4616-9b57-f1b5ba2bd84e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1264 microversion: 2.1 time: 0.156097 Aug 30 05:18:25.770557 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 403/836] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:25 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:26.062102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-f9a56e10-573a-4524-87a9-724616ae9105 req-e68e26ba-24ad-41c4-9e83-3812906a8c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bf81ed-0c85-4375-8e3b-eb18b7a48385", "name": "network-vif-plugged", "status": "completed", "tag": "1ef774e8-0aae-4b74-9370-1e268ea393a2"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:18:26.071768 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-f9a56e10-573a-4524-87a9-724616ae9105 req-e68e26ba-24ad-41c4-9e83-3812906a8c52 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:26.072240 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-f9a56e10-573a-4524-87a9-724616ae9105 req-e68e26ba-24ad-41c4-9e83-3812906a8c52 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:26.072668 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-f9a56e10-573a-4524-87a9-724616ae9105 req-e68e26ba-24ad-41c4-9e83-3812906a8c52 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:26.083139 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-f9a56e10-573a-4524-87a9-724616ae9105 req-e68e26ba-24ad-41c4-9e83-3812906a8c52 service nova] Creating event network-vif-plugged:1ef774e8-0aae-4b74-9370-1e268ea393a2 for instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 on hv-cinder-85391 Aug 30 05:18:26.088313 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-f9a56e10-573a-4524-87a9-724616ae9105 req-e68e26ba-24ad-41c4-9e83-3812906a8c52 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029892 Aug 30 05:18:26.088877 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 434/837] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:26.351528 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-49d5884e-9660-49f2-903e-457c5533a75d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:26.352145 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-49d5884e-9660-49f2-903e-457c5533a75d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:26.358586 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d5884e-9660-49f2-903e-457c5533a75d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:26.359108 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d5884e-9660-49f2-903e-457c5533a75d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:26.359548 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d5884e-9660-49f2-903e-457c5533a75d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:26.360267 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d5884e-9660-49f2-903e-457c5533a75d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:26.360753 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d5884e-9660-49f2-903e-457c5533a75d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:26.361178 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-49d5884e-9660-49f2-903e-457c5533a75d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:26.443737 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-625e94a5-724a-4228-a230-5d8bed3a5a52 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:26.444316 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-625e94a5-724a-4228-a230-5d8bed3a5a52 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:26.450712 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-625e94a5-724a-4228-a230-5d8bed3a5a52 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:26.451309 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-625e94a5-724a-4228-a230-5d8bed3a5a52 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:26.451885 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-625e94a5-724a-4228-a230-5d8bed3a5a52 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:26.452691 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-625e94a5-724a-4228-a230-5d8bed3a5a52 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:26.453241 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-625e94a5-724a-4228-a230-5d8bed3a5a52 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:26.453716 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-625e94a5-724a-4228-a230-5d8bed3a5a52 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:26.469119 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-625e94a5-724a-4228-a230-5d8bed3a5a52 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] HTTP exception thrown: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-625e94a5-724a-4228-a230-5d8bed3a5a52 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Request method failure captured: Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 HTTP/1.1 Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZwiTTjIdFLzbpKGGpVA3DA-wQMC11XCY2BH6iqM7GBty3a3ccClw13LpIkL82s1_zUTcGUl6Fxcxen95MvsmbIMvoGt9q6XWYGOnL0LH9Um7BPa8yeMLK-bSKBoqaJjPxzTDkf7rQc9Wiq858Zw38xN0TvFDFaisonA92G3wQeNg1c Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 116fb506b7794c1fa9460b5a861de136 Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:18:26.470844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:18:26.472408 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_116fb506b7794c1fa9460b5a861de136", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:18:26.472408 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:18:26.472408 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 116fb506b7794c1fa9460b5a861de136 Aug 30 05:18:26.472408 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:18:26.472408 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeTestJSON-1134370107-project Aug 30 05:18:26.472408 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:18:26.472408 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:18:26.472408 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: a8f01d0042c84767899dc2b71bca4e12 Aug 30 05:18:26.472408 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeTestJSON-1134370107-project Aug 30 05:18:26.472408 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:18:26.472408 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. Aug 30 05:18:26.472408 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '2a54dc6f-8cee-4b66-9486-491841d01c27'} Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:18:26.473232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. Aug 30 05:18:26.474426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:26.475689 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-625e94a5-724a-4228-a230-5d8bed3a5a52 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Returning 404 to user: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:18:26.475689 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-625e94a5-724a-4228-a230-5d8bed3a5a52 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "DELETE /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 404 len: 111 microversion: 2.1 time: 0.033247 Aug 30 05:18:26.475689 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 435/838] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:18:26 2022] DELETE /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:18:26.480432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-18d05d1d-a07d-4af6-a3a8-dd6c803118d4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:26.481047 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-18d05d1d-a07d-4af6-a3a8-dd6c803118d4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] [instance: 2a54dc6f-8cee-4b66-9486-491841d01c27] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:26.486681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18d05d1d-a07d-4af6-a3a8-dd6c803118d4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:26.487204 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18d05d1d-a07d-4af6-a3a8-dd6c803118d4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:26.487641 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18d05d1d-a07d-4af6-a3a8-dd6c803118d4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:26.488331 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18d05d1d-a07d-4af6-a3a8-dd6c803118d4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:26.488781 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18d05d1d-a07d-4af6-a3a8-dd6c803118d4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:26.489205 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-18d05d1d-a07d-4af6-a3a8-dd6c803118d4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:26.493112 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-49d5884e-9660-49f2-903e-457c5533a75d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:26.500963 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-49d5884e-9660-49f2-903e-457c5533a75d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:26.502400 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-49d5884e-9660-49f2-903e-457c5533a75d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:26.502529 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-18d05d1d-a07d-4af6-a3a8-dd6c803118d4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] HTTP exception thrown: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. Aug 30 05:18:26.503591 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-49d5884e-9660-49f2-903e-457c5533a75d tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.156681 Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-18d05d1d-a07d-4af6-a3a8-dd6c803118d4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Request method failure captured: Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 HTTP/1.1 Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZwiTTjIdFLzbpKGGpVA3DA-wQMC11XCY2BH6iqM7GBty3a3ccClw13LpIkL82s1_zUTcGUl6Fxcxen95MvsmbIMvoGt9q6XWYGOnL0LH9Um7BPa8yeMLK-bSKBoqaJjPxzTDkf7rQc9Wiq858Zw38xN0TvFDFaisonA92G3wQeNg1c Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 116fb506b7794c1fa9460b5a861de136 Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:18:26.508011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:18:26.509358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/116fb506b7794c1fa9460b5a861de136"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_116fb506b7794c1fa9460b5a861de136", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:18:26.509358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:18:26.509358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 116fb506b7794c1fa9460b5a861de136 Aug 30 05:18:26.509358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1134370107 Aug 30 05:18:26.509358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeTestJSON-1134370107-project Aug 30 05:18:26.509358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:18:26.509358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:18:26.509358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: a8f01d0042c84767899dc2b71bca4e12 Aug 30 05:18:26.509358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeTestJSON-1134370107-project Aug 30 05:18:26.509358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:18:26.509358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. Aug 30 05:18:26.509358 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '2a54dc6f-8cee-4b66-9486-491841d01c27'} Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:18:26.510159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. Aug 30 05:18:26.511406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:26.512512 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 404/839] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:26 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:26.512690 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-18d05d1d-a07d-4af6-a3a8-dd6c803118d4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] Returning 404 to user: Instance 2a54dc6f-8cee-4b66-9486-491841d01c27 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:18:26.512690 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-18d05d1d-a07d-4af6-a3a8-dd6c803118d4 tempest-AttachVolumeTestJSON-1134370107 tempest-AttachVolumeTestJSON-1134370107-project] 10.222.0.77 "GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27" status: 404 len: 111 microversion: 2.1 time: 0.028730 Aug 30 05:18:26.512690 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 436/840] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:26 2022] GET /compute/v2.1/servers/2a54dc6f-8cee-4b66-9486-491841d01c27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:18:26.790613 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9ae0728b-9441-4fbf-aedd-9ee62a323028 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:26.791158 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9ae0728b-9441-4fbf-aedd-9ee62a323028 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:26.796914 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ae0728b-9441-4fbf-aedd-9ee62a323028 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:26.797399 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ae0728b-9441-4fbf-aedd-9ee62a323028 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:26.797829 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ae0728b-9441-4fbf-aedd-9ee62a323028 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:26.798512 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ae0728b-9441-4fbf-aedd-9ee62a323028 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:26.799000 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ae0728b-9441-4fbf-aedd-9ee62a323028 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:26.799421 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9ae0728b-9441-4fbf-aedd-9ee62a323028 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:27.024491 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9ae0728b-9441-4fbf-aedd-9ee62a323028 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:27.032173 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9ae0728b-9441-4fbf-aedd-9ee62a323028 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1452 microversion: 2.1 time: 0.245434 Aug 30 05:18:27.032748 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 405/841] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:26 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1452 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:27.051993 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-45f14888-182f-4643-a26d-d1605ea26ead tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:27.053275 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-45f14888-182f-4643-a26d-d1605ea26ead tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:27.059238 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45f14888-182f-4643-a26d-d1605ea26ead tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:27.059799 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45f14888-182f-4643-a26d-d1605ea26ead tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:27.060310 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45f14888-182f-4643-a26d-d1605ea26ead tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:27.061082 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45f14888-182f-4643-a26d-d1605ea26ead tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:27.061630 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45f14888-182f-4643-a26d-d1605ea26ead tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:27.062162 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-45f14888-182f-4643-a26d-d1605ea26ead tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:27.191911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-45f14888-182f-4643-a26d-d1605ea26ead tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:27.200507 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-45f14888-182f-4643-a26d-d1605ea26ead tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1452 microversion: 2.1 time: 0.152397 Aug 30 05:18:27.201078 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 437/842] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:27 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:27.526398 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-82838ff5-8fdb-49d3-9120-15abae099e1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:27.527078 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-82838ff5-8fdb-49d3-9120-15abae099e1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:27.533828 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82838ff5-8fdb-49d3-9120-15abae099e1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:27.534323 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82838ff5-8fdb-49d3-9120-15abae099e1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:27.534993 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82838ff5-8fdb-49d3-9120-15abae099e1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:27.535793 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82838ff5-8fdb-49d3-9120-15abae099e1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:27.536254 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82838ff5-8fdb-49d3-9120-15abae099e1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:27.537219 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-82838ff5-8fdb-49d3-9120-15abae099e1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:27.947732 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-82838ff5-8fdb-49d3-9120-15abae099e1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:27.955803 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-82838ff5-8fdb-49d3-9120-15abae099e1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:27.957303 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-82838ff5-8fdb-49d3-9120-15abae099e1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:27.958509 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-82838ff5-8fdb-49d3-9120-15abae099e1f tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1728 microversion: 2.20 time: 0.436217 Aug 30 05:18:27.959765 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 406/843] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:27 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1728 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:28.981749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-646f351c-5fcc-4a10-9c97-75f56e74ade3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:28.982304 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-646f351c-5fcc-4a10-9c97-75f56e74ade3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:28.992136 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-646f351c-5fcc-4a10-9c97-75f56e74ade3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:28.993162 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-646f351c-5fcc-4a10-9c97-75f56e74ade3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:28.994276 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-646f351c-5fcc-4a10-9c97-75f56e74ade3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:28.995665 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-646f351c-5fcc-4a10-9c97-75f56e74ade3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:28.996592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-646f351c-5fcc-4a10-9c97-75f56e74ade3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:28.997447 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-646f351c-5fcc-4a10-9c97-75f56e74ade3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:29.166536 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-646f351c-5fcc-4a10-9c97-75f56e74ade3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:29.175155 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-646f351c-5fcc-4a10-9c97-75f56e74ade3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:29.176859 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-646f351c-5fcc-4a10-9c97-75f56e74ade3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:29.178159 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-646f351c-5fcc-4a10-9c97-75f56e74ade3 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1715 microversion: 2.20 time: 0.200445 Aug 30 05:18:29.178714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 438/844] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:18:28 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1715 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:18:30.757831 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-577728c0-7242-4009-a211-666dca479821 req-6a75db89-fd08-4aef-9f4b-82bd64049ac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23b1f7be-c451-470d-8117-4dd0164f568b", "tag": "33dc5fe2-b49b-46cd-bbea-d50e70e21301"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:18:30.769169 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-577728c0-7242-4009-a211-666dca479821 req-6a75db89-fd08-4aef-9f4b-82bd64049ac7 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:30.769648 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-577728c0-7242-4009-a211-666dca479821 req-6a75db89-fd08-4aef-9f4b-82bd64049ac7 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:30.770079 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-577728c0-7242-4009-a211-666dca479821 req-6a75db89-fd08-4aef-9f4b-82bd64049ac7 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:30.788997 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-577728c0-7242-4009-a211-666dca479821 req-6a75db89-fd08-4aef-9f4b-82bd64049ac7 service nova] Creating event network-changed:33dc5fe2-b49b-46cd-bbea-d50e70e21301 for instance 23b1f7be-c451-470d-8117-4dd0164f568b on hv-cinder-85391 Aug 30 05:18:30.794863 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-577728c0-7242-4009-a211-666dca479821 req-6a75db89-fd08-4aef-9f4b-82bd64049ac7 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041369 Aug 30 05:18:30.795646 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 407/845] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:18:32.688760 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3a279c2c-ccca-47c5-b2bc-b2c53a42ed83 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Action: 'create', calling method: .version_select at 0x7f822ed210d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1619344817"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:18:32.989182 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3a279c2c-ccca-47c5-b2bc-b2c53a42ed83 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.409704 Aug 30 05:18:32.990373 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 439/846] 10.222.0.77 () {60 vars in 1155 bytes} [Tue Aug 30 05:18:32 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 412 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 05:18:33.003889 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1c5e2ed6-1a54-4e79-a2a9-3117aa1475b3 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Calling method '.version_select at 0x7f822ec5ce50>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:33.065916 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1c5e2ed6-1a54-4e79-a2a9-3117aa1475b3 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a" status: 200 len: 345 microversion: 2.1 time: 0.066959 Aug 30 05:18:33.066487 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 408/847] 10.222.0.77 () {58 vars in 1245 bytes} [Tue Aug 30 05:18:32 2022] GET /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:34.080939 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-abfb18b7-c349-4a72-a28d-f2affe1869a0 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Calling method '.version_select at 0x7f8232675700>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:34.126442 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-abfb18b7-c349-4a72-a28d-f2affe1869a0 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a" status: 200 len: 346 microversion: 2.1 time: 0.049923 Aug 30 05:18:34.127033 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 440/848] 10.222.0.77 () {58 vars in 1245 bytes} [Tue Aug 30 05:18:34 2022] GET /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:34.139664 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-efe7af09-a89e-4dd8-9164-55a128f46ab2 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Action: 'create', calling method: .version_select at 0x7f822ec364c0>, body: {"snapshot": {"volume_id": "b595502f-6946-47cf-976c-7df97aa3f66a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-525551965"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:18:34.282414 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-efe7af09-a89e-4dd8-9164-55a128f46ab2 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.147083 Aug 30 05:18:34.283113 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 409/849] 10.222.0.77 () {60 vars in 1162 bytes} [Tue Aug 30 05:18:34 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:34.294218 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6f24a690-1b42-4d0e-8e03-24b2f48bfb3a tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Calling method '.version_select at 0x7f8232675dc0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:34.325107 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6f24a690-1b42-4d0e-8e03-24b2f48bfb3a tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d" status: 200 len: 286 microversion: 2.1 time: 0.034639 Aug 30 05:18:34.325774 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 441/850] 10.222.0.77 () {58 vars in 1251 bytes} [Tue Aug 30 05:18:34 2022] GET /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:34.337036 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4ff5f370-b291-4e80-a8f4-ca228af1330f tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Calling method '.version_select at 0x7f822ec335e0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:34.369241 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4ff5f370-b291-4e80-a8f4-ca228af1330f tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036423 Aug 30 05:18:34.369906 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 410/851] 10.222.0.77 () {58 vars in 1140 bytes} [Tue Aug 30 05:18:34 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:34.380913 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ddd2328a-04a0-4a8e-9f54-f4ad49059d61 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Calling method '.version_select at 0x7f82326758b0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:34.409566 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ddd2328a-04a0-4a8e-9f54-f4ad49059d61 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d" status: 200 len: 286 microversion: 2.1 time: 0.032352 Aug 30 05:18:34.410110 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 442/852] 10.222.0.77 () {58 vars in 1251 bytes} [Tue Aug 30 05:18:34 2022] GET /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:35.423022 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-22212a5f-45ec-4c2c-8bf1-4f7ffbf49129 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Calling method '.version_select at 0x7f822eca83a0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:35.452510 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-22212a5f-45ec-4c2c-8bf1-4f7ffbf49129 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d" status: 200 len: 286 microversion: 2.1 time: 0.033886 Aug 30 05:18:35.453065 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 411/853] 10.222.0.77 () {58 vars in 1251 bytes} [Tue Aug 30 05:18:35 2022] GET /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:36.465406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dc0c3b90-3edf-4b5a-bbd8-a36c783c45aa tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Calling method '.version_select at 0x7f8232642c10>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:36.495826 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dc0c3b90-3edf-4b5a-bbd8-a36c783c45aa tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d" status: 200 len: 286 microversion: 2.1 time: 0.034683 Aug 30 05:18:36.496387 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 443/854] 10.222.0.77 () {58 vars in 1251 bytes} [Tue Aug 30 05:18:36 2022] GET /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:37.508743 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-faebe31e-d766-4c5e-810a-3d5030bb923d tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Calling method '.version_select at 0x7f822ec99c10>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:37.538431 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-faebe31e-d766-4c5e-810a-3d5030bb923d tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d" status: 200 len: 287 microversion: 2.1 time: 0.034108 Aug 30 05:18:37.539129 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 412/855] 10.222.0.77 () {58 vars in 1251 bytes} [Tue Aug 30 05:18:37 2022] GET /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:37.550348 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f9e16e6f-5eba-45c3-9883-00cf39484074 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Calling method '.version_select at 0x7f822ed21160>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:37.607500 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f9e16e6f-5eba-45c3-9883-00cf39484074 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "DELETE /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d" status: 202 len: 0 microversion: 2.1 time: 0.061317 Aug 30 05:18:37.608054 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 444/856] 10.222.0.77 () {58 vars in 1254 bytes} [Tue Aug 30 05:18:37 2022] DELETE /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:18:37.616225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-55915f5a-02fe-4942-b0c0-e95c1cb84bb6 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Calling method '.version_select at 0x7f822ec99940>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:37.644916 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-55915f5a-02fe-4942-b0c0-e95c1cb84bb6 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d" status: 200 len: 286 microversion: 2.1 time: 0.032466 Aug 30 05:18:37.645514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 413/857] 10.222.0.77 () {58 vars in 1251 bytes} [Tue Aug 30 05:18:37 2022] GET /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:38.657898 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-257b894d-4a55-4eea-8a71-be20253e956a tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Calling method '.version_select at 0x7f822ecac0d0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:38.681688 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-257b894d-4a55-4eea-8a71-be20253e956a tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] HTTP exception thrown: Snapshot 6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d could not be found. Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-257b894d-4a55-4eea-8a71-be20253e956a tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Request method failure captured: Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d HTTP/1.1 Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZ2oHLi0GlfgZg0HnPa4H3Xuv1KG6klRYWJdMIMKHHUQdExC3N_llQImkmAmY9MC0JD6m8GuTuX0OuDSxvhM0GLoTY63r94MjSCWJTgIL3gxv3Tbphk_VaJPaHXl4xdVOUzL1EZi2u5nPLdH2O_HsvuqnOTUJ3iO583LDN-x85rgGjU Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 4ab62e21e615415ebe36b51bd9055c79 Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-935495866 Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:18:38.684833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:18:38.686432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/4ab62e21e615415ebe36b51bd9055c79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/4ab62e21e615415ebe36b51bd9055c79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/4ab62e21e615415ebe36b51bd9055c79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_4ab62e21e615415ebe36b51bd9055c79", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:18:38.686432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesSnapshotsTestJSON-935495866 Aug 30 05:18:38.686432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 4ab62e21e615415ebe36b51bd9055c79 Aug 30 05:18:38.686432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-935495866 Aug 30 05:18:38.686432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesSnapshotsTestJSON-935495866-project Aug 30 05:18:38.686432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:18:38.686432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:18:38.686432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: 3360e6177b2d4626b9d3148196761829 Aug 30 05:18:38.686432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesSnapshotsTestJSON-935495866-project Aug 30 05:18:38.686432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: Aug 30 05:18:38.686432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Snapshot 6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d could not be found. Aug 30 05:18:38.686432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d'} Aug 30 05:18:38.686432 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d could not be found. (HTTP 404) (Request-ID: req-97ea7113-2d79-44d9-8fad-891964d6f8ef) Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:38.687494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 05:18:38.688823 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d could not be found. Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 05:18:38.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:18:38.691821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d could not be found. Aug 30 05:18:38.691821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:38.691821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:38.691821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:38.691821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:38.691821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:38.691821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:38.691821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:18:38.691821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:18:38.691821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d could not be found. Aug 30 05:18:38.691821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:38.691821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-257b894d-4a55-4eea-8a71-be20253e956a tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Returning 404 to user: Snapshot 6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:18:38.691821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-257b894d-4a55-4eea-8a71-be20253e956a tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "GET /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d" status: 404 len: 111 microversion: 2.1 time: 0.032641 Aug 30 05:18:38.691821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 445/858] 10.222.0.77 () {58 vars in 1251 bytes} [Tue Aug 30 05:18:38 2022] GET /compute/v2.1/os-snapshots/6e4c7ec8-e261-4cbb-8b4b-f4e2c80f7b3d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:18:38.695880 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1edb02d2-7978-4819-9a96-35e8cc30c2ef tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Calling method '.version_select at 0x7f822ec33280>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:38.758769 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1edb02d2-7978-4819-9a96-35e8cc30c2ef tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a" status: 202 len: 0 microversion: 2.1 time: 0.067595 Aug 30 05:18:38.759361 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 414/859] 10.222.0.77 () {58 vars in 1248 bytes} [Tue Aug 30 05:18:38 2022] DELETE /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:18:38.767780 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-75bdf106-05b0-40c4-bf8b-daa811abcbcb tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Calling method '.version_select at 0x7f82326253a0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:38.815898 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-75bdf106-05b0-40c4-bf8b-daa811abcbcb tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a" status: 200 len: 345 microversion: 2.1 time: 0.051886 Aug 30 05:18:38.816457 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 446/860] 10.222.0.77 () {58 vars in 1245 bytes} [Tue Aug 30 05:18:38 2022] GET /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:39.830133 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e5f3c484-ba7c-4ecd-8f9f-329ecf48bbd9 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Calling method '.version_select at 0x7f822ec7f670>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:39.858755 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-e5f3c484-ba7c-4ecd-8f9f-329ecf48bbd9 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] HTTP exception thrown: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e5f3c484-ba7c-4ecd-8f9f-329ecf48bbd9 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Request method failure captured: Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a HTTP/1.1 Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZ2oHLi0GlfgZg0HnPa4H3Xuv1KG6klRYWJdMIMKHHUQdExC3N_llQImkmAmY9MC0JD6m8GuTuX0OuDSxvhM0GLoTY63r94MjSCWJTgIL3gxv3Tbphk_VaJPaHXl4xdVOUzL1EZi2u5nPLdH2O_HsvuqnOTUJ3iO583LDN-x85rgGjU Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: 4ab62e21e615415ebe36b51bd9055c79 Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-935495866 Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:18:39.862245 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:18:39.863859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/4ab62e21e615415ebe36b51bd9055c79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/4ab62e21e615415ebe36b51bd9055c79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/4ab62e21e615415ebe36b51bd9055c79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_4ab62e21e615415ebe36b51bd9055c79", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:18:39.863859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesSnapshotsTestJSON-935495866 Aug 30 05:18:39.863859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 4ab62e21e615415ebe36b51bd9055c79 Aug 30 05:18:39.863859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-935495866 Aug 30 05:18:39.863859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesSnapshotsTestJSON-935495866-project Aug 30 05:18:39.863859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:18:39.863859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:18:39.863859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: 3360e6177b2d4626b9d3148196761829 Aug 30 05:18:39.863859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesSnapshotsTestJSON-935495866-project Aug 30 05:18:39.863859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: Aug 30 05:18:39.863859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. Aug 30 05:18:39.863859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': 'b595502f-6946-47cf-976c-7df97aa3f66a'} Aug 30 05:18:39.863859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. (HTTP 404) (Request-ID: req-23ac5560-daf7-4c41-bbbd-61188a26044d) Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:39.864716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 05:18:39.865992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 05:18:39.867506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:18:39.868833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. Aug 30 05:18:39.868833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.868833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:39.868833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.868833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:39.868833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:39.868833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:39.868833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:18:39.868833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:18:39.868833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. Aug 30 05:18:39.868833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.868833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e5f3c484-ba7c-4ecd-8f9f-329ecf48bbd9 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Returning 404 to user: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:18:39.868833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e5f3c484-ba7c-4ecd-8f9f-329ecf48bbd9 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a" status: 404 len: 109 microversion: 2.1 time: 0.038141 Aug 30 05:18:39.868833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 415/861] 10.222.0.77 () {58 vars in 1245 bytes} [Tue Aug 30 05:18:39 2022] GET /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:18:39.874450 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:39.875243 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=78 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:39.879724 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ab3e475c-5af0-4656-8b68-70f8ebb61b26 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Calling method '.version_select at 0x7f8232625280>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:39.907414 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-ab3e475c-5af0-4656-8b68-70f8ebb61b26 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] HTTP exception thrown: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ab3e475c-5af0-4656-8b68-70f8ebb61b26 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Request method failure captured: Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a HTTP/1.1 Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZ2oHLi0GlfgZg0HnPa4H3Xuv1KG6klRYWJdMIMKHHUQdExC3N_llQImkmAmY9MC0JD6m8GuTuX0OuDSxvhM0GLoTY63r94MjSCWJTgIL3gxv3Tbphk_VaJPaHXl4xdVOUzL1EZi2u5nPLdH2O_HsvuqnOTUJ3iO583LDN-x85rgGjU Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 4ab62e21e615415ebe36b51bd9055c79 Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-935495866 Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:18:39.909748 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:18:39.911277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/4ab62e21e615415ebe36b51bd9055c79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/4ab62e21e615415ebe36b51bd9055c79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/4ab62e21e615415ebe36b51bd9055c79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_4ab62e21e615415ebe36b51bd9055c79", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:18:39.911277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesSnapshotsTestJSON-935495866 Aug 30 05:18:39.911277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 4ab62e21e615415ebe36b51bd9055c79 Aug 30 05:18:39.911277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-935495866 Aug 30 05:18:39.911277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesSnapshotsTestJSON-935495866-project Aug 30 05:18:39.911277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:18:39.911277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:18:39.911277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: 3360e6177b2d4626b9d3148196761829 Aug 30 05:18:39.911277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesSnapshotsTestJSON-935495866-project Aug 30 05:18:39.911277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: Aug 30 05:18:39.911277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. Aug 30 05:18:39.911277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': 'b595502f-6946-47cf-976c-7df97aa3f66a'} Aug 30 05:18:39.911277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. (HTTP 404) (Request-ID: req-a5caf681-3422-4a9e-963e-054a00321fea) Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:39.912766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 05:18:39.914125 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 05:18:39.915476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:18:39.917163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. Aug 30 05:18:39.917163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.917163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:39.917163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.917163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:39.917163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:39.917163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:39.917163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:18:39.917163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:18:39.917163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. Aug 30 05:18:39.917163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.917163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ab3e475c-5af0-4656-8b68-70f8ebb61b26 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Returning 404 to user: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:18:39.917163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ab3e475c-5af0-4656-8b68-70f8ebb61b26 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a" status: 404 len: 109 microversion: 2.1 time: 0.037846 Aug 30 05:18:39.917163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 447/862] 10.222.0.77 () {58 vars in 1248 bytes} [Tue Aug 30 05:18:39 2022] DELETE /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:18:39.920457 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2de23cec-bb6d-41f5-ae74-6362a43ec806 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Calling method '.version_select at 0x7f822ecfb430>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:39.950030 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-2de23cec-bb6d-41f5-ae74-6362a43ec806 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] HTTP exception thrown: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2de23cec-bb6d-41f5-ae74-6362a43ec806 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Request method failure captured: Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a HTTP/1.1 Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZ2oHLi0GlfgZg0HnPa4H3Xuv1KG6klRYWJdMIMKHHUQdExC3N_llQImkmAmY9MC0JD6m8GuTuX0OuDSxvhM0GLoTY63r94MjSCWJTgIL3gxv3Tbphk_VaJPaHXl4xdVOUzL1EZi2u5nPLdH2O_HsvuqnOTUJ3iO583LDN-x85rgGjU Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: 4ab62e21e615415ebe36b51bd9055c79 Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-935495866 Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:18:39.952010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:18:39.953485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/4ab62e21e615415ebe36b51bd9055c79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/4ab62e21e615415ebe36b51bd9055c79"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/4ab62e21e615415ebe36b51bd9055c79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_4ab62e21e615415ebe36b51bd9055c79", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:18:39.953485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesSnapshotsTestJSON-935495866 Aug 30 05:18:39.953485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 4ab62e21e615415ebe36b51bd9055c79 Aug 30 05:18:39.953485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-935495866 Aug 30 05:18:39.953485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesSnapshotsTestJSON-935495866-project Aug 30 05:18:39.953485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:18:39.953485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:18:39.953485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: 3360e6177b2d4626b9d3148196761829 Aug 30 05:18:39.953485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesSnapshotsTestJSON-935495866-project Aug 30 05:18:39.953485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: Aug 30 05:18:39.953485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. Aug 30 05:18:39.953485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': 'b595502f-6946-47cf-976c-7df97aa3f66a'} Aug 30 05:18:39.953485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. (HTTP 404) (Request-ID: req-0789d184-cef4-482e-8599-0c8474b183c2) Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:39.954524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 05:18:39.956225 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 05:18:39.957708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:18:39.959698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. Aug 30 05:18:39.959698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.959698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:18:39.959698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.959698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:18:39.959698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:18:39.959698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:18:39.959698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:18:39.959698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:18:39.959698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. Aug 30 05:18:39.959698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:18:39.959698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2de23cec-bb6d-41f5-ae74-6362a43ec806 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] Returning 404 to user: Volume b595502f-6946-47cf-976c-7df97aa3f66a could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:18:39.959698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2de23cec-bb6d-41f5-ae74-6362a43ec806 tempest-VolumesSnapshotsTestJSON-935495866 tempest-VolumesSnapshotsTestJSON-935495866-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a" status: 404 len: 109 microversion: 2.1 time: 0.036761 Aug 30 05:18:39.959698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 416/863] 10.222.0.77 () {58 vars in 1245 bytes} [Tue Aug 30 05:18:39 2022] GET /compute/v2.1/os-volumes/b595502f-6946-47cf-976c-7df97aa3f66a => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:19:02.858878 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0efbbc04-3618-4d47-ad07-01ca3bc60252 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:02.862168 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0efbbc04-3618-4d47-ad07-01ca3bc60252 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:02.868956 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0efbbc04-3618-4d47-ad07-01ca3bc60252 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:02.869510 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0efbbc04-3618-4d47-ad07-01ca3bc60252 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:02.870012 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0efbbc04-3618-4d47-ad07-01ca3bc60252 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:02.870779 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0efbbc04-3618-4d47-ad07-01ca3bc60252 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:02.871248 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0efbbc04-3618-4d47-ad07-01ca3bc60252 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:02.871675 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0efbbc04-3618-4d47-ad07-01ca3bc60252 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:02.903780 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0efbbc04-3618-4d47-ad07-01ca3bc60252 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050873 Aug 30 05:19:02.904323 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 448/864] 10.222.0.77 () {60 vars in 1343 bytes} [Tue Aug 30 05:19:02 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:02.963854 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=91 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:02.964603 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=81 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:02.970361 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-71ea2d62-155f-4eb0-968c-442cfe1e8928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:02.970980 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-71ea2d62-155f-4eb0-968c-442cfe1e8928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:02.978644 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71ea2d62-155f-4eb0-968c-442cfe1e8928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:02.979156 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71ea2d62-155f-4eb0-968c-442cfe1e8928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:02.979597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71ea2d62-155f-4eb0-968c-442cfe1e8928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:02.980284 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71ea2d62-155f-4eb0-968c-442cfe1e8928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:02.980774 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71ea2d62-155f-4eb0-968c-442cfe1e8928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:02.981199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-71ea2d62-155f-4eb0-968c-442cfe1e8928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:03.005706 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-71ea2d62-155f-4eb0-968c-442cfe1e8928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:19:03.080902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-71ea2d62-155f-4eb0-968c-442cfe1e8928 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "DELETE /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 204 len: 0 microversion: 2.20 time: 0.117449 Aug 30 05:19:03.081422 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 417/865] 10.222.0.77 () {60 vars in 1280 bytes} [Tue Aug 30 05:19:02 2022] DELETE /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 05:19:03.090664 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-79d0411c-e200-4b2f-b9d5-672015d469f2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:03.091875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-79d0411c-e200-4b2f-b9d5-672015d469f2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:03.098413 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79d0411c-e200-4b2f-b9d5-672015d469f2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:03.099017 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79d0411c-e200-4b2f-b9d5-672015d469f2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:03.099626 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79d0411c-e200-4b2f-b9d5-672015d469f2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:03.100649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79d0411c-e200-4b2f-b9d5-672015d469f2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:03.103467 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79d0411c-e200-4b2f-b9d5-672015d469f2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:03.103897 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-79d0411c-e200-4b2f-b9d5-672015d469f2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:03.236555 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-79d0411c-e200-4b2f-b9d5-672015d469f2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:03.244555 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-79d0411c-e200-4b2f-b9d5-672015d469f2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:03.246768 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-79d0411c-e200-4b2f-b9d5-672015d469f2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:03.248242 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-79d0411c-e200-4b2f-b9d5-672015d469f2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1721 microversion: 2.20 time: 0.162424 Aug 30 05:19:03.248804 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 449/866] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:19:03 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:19:04.272374 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8157c384-9b73-46d9-a9f4-fa3a6f6bfa98 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:04.273071 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8157c384-9b73-46d9-a9f4-fa3a6f6bfa98 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:04.280304 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8157c384-9b73-46d9-a9f4-fa3a6f6bfa98 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:04.280786 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8157c384-9b73-46d9-a9f4-fa3a6f6bfa98 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:04.281246 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8157c384-9b73-46d9-a9f4-fa3a6f6bfa98 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:04.281963 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8157c384-9b73-46d9-a9f4-fa3a6f6bfa98 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:04.282449 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8157c384-9b73-46d9-a9f4-fa3a6f6bfa98 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:04.282906 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8157c384-9b73-46d9-a9f4-fa3a6f6bfa98 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:04.414836 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8157c384-9b73-46d9-a9f4-fa3a6f6bfa98 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:04.423479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8157c384-9b73-46d9-a9f4-fa3a6f6bfa98 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:04.424910 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8157c384-9b73-46d9-a9f4-fa3a6f6bfa98 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:04.426061 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8157c384-9b73-46d9-a9f4-fa3a6f6bfa98 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1721 microversion: 2.20 time: 0.157973 Aug 30 05:19:04.426615 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 418/867] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:19:04 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:19:05.448828 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5b7c677a-d68c-44cf-962f-64d959d6ef45 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:05.449450 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5b7c677a-d68c-44cf-962f-64d959d6ef45 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:05.458781 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b7c677a-d68c-44cf-962f-64d959d6ef45 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:05.459508 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b7c677a-d68c-44cf-962f-64d959d6ef45 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:05.460110 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b7c677a-d68c-44cf-962f-64d959d6ef45 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:05.461031 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b7c677a-d68c-44cf-962f-64d959d6ef45 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:05.461643 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b7c677a-d68c-44cf-962f-64d959d6ef45 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:05.462219 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5b7c677a-d68c-44cf-962f-64d959d6ef45 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:05.527709 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-44d8f8b4-7e0e-410c-8a5b-3b7da09ce346 req-346dcdce-663c-4aec-a959-a3a8c49a682d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bf81ed-0c85-4375-8e3b-eb18b7a48385", "name": "network-vif-deleted", "tag": "1ef774e8-0aae-4b74-9370-1e268ea393a2"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:19:05.541119 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-44d8f8b4-7e0e-410c-8a5b-3b7da09ce346 req-346dcdce-663c-4aec-a959-a3a8c49a682d service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:05.541946 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-44d8f8b4-7e0e-410c-8a5b-3b7da09ce346 req-346dcdce-663c-4aec-a959-a3a8c49a682d service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:05.542599 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-44d8f8b4-7e0e-410c-8a5b-3b7da09ce346 req-346dcdce-663c-4aec-a959-a3a8c49a682d service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:05.555651 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-44d8f8b4-7e0e-410c-8a5b-3b7da09ce346 req-346dcdce-663c-4aec-a959-a3a8c49a682d service nova] Creating event network-vif-deleted:1ef774e8-0aae-4b74-9370-1e268ea393a2 for instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 on hv-cinder-85391 Aug 30 05:19:05.562709 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-44d8f8b4-7e0e-410c-8a5b-3b7da09ce346 req-346dcdce-663c-4aec-a959-a3a8c49a682d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039109 Aug 30 05:19:05.563835 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 419/868] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:19:05.573138 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5b7c677a-d68c-44cf-962f-64d959d6ef45 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:05.587291 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5b7c677a-d68c-44cf-962f-64d959d6ef45 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:05.589402 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5b7c677a-d68c-44cf-962f-64d959d6ef45 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2fe451987a8c49c5b5fc0ef1c9c30ab5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea4da0dbf3a44eabbff29f884beb157', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:05.591781 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5b7c677a-d68c-44cf-962f-64d959d6ef45 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 200 len: 1653 microversion: 2.20 time: 0.146383 Aug 30 05:19:05.607152 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 450/869] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:19:05 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 1653 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 05:19:06.621566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-138bff6f-5ef8-4d91-9884-b80e768a8f8e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:06.622739 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-138bff6f-5ef8-4d91-9884-b80e768a8f8e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:06.629465 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-138bff6f-5ef8-4d91-9884-b80e768a8f8e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:06.629953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-138bff6f-5ef8-4d91-9884-b80e768a8f8e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:06.630391 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-138bff6f-5ef8-4d91-9884-b80e768a8f8e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:06.631120 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-138bff6f-5ef8-4d91-9884-b80e768a8f8e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:06.631579 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-138bff6f-5ef8-4d91-9884-b80e768a8f8e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:06.632002 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-138bff6f-5ef8-4d91-9884-b80e768a8f8e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:06.645258 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-138bff6f-5ef8-4d91-9884-b80e768a8f8e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] HTTP exception thrown: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-138bff6f-5ef8-4d91-9884-b80e768a8f8e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Request method failure captured: Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 HTTP/1.1 Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZwl_-AzLktv9UBO21qLWbSU6vb7BZkLMh5hLm0P1OlGuDZbbTyQzPWwTtQ0kxD3e-WS2lSgbqPG7l1Unj1ExmcdV6I8fixfHUk3d4jQdtzDYnuJCmZIyLv4thuTEMOgQ-d18n_gdPJooZxoEBXGRkBfZ_ADEmrEtz7X1JeFVxRKH24 Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: 7ea4da0dbf3a44eabbff29f884beb157 Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:19:06.646902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:19:06.648566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_7ea4da0dbf3a44eabbff29f884beb157", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:19:06.648566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:19:06.648566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 7ea4da0dbf3a44eabbff29f884beb157 Aug 30 05:19:06.648566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:19:06.648566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeShelveTestJSON-696047995-project Aug 30 05:19:06.648566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:19:06.648566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:19:06.648566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: 2fe451987a8c49c5b5fc0ef1c9c30ab5 Aug 30 05:19:06.648566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeShelveTestJSON-696047995-project Aug 30 05:19:06.648566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:19:06.648566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. Aug 30 05:19:06.648566 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': '04bf81ed-0c85-4375-8e3b-eb18b7a48385'} Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:19:06.649507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. Aug 30 05:19:06.651516 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:06.653093 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-138bff6f-5ef8-4d91-9884-b80e768a8f8e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Returning 404 to user: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:19:06.653093 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-138bff6f-5ef8-4d91-9884-b80e768a8f8e tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 404 len: 111 microversion: 2.20 time: 0.030992 Aug 30 05:19:06.653093 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 420/870] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:19:06 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 05:19:06.657437 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6ba7a6ef-7118-40b7-a3ad-38161f7abcef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '.version_select at 0x7f82326268b0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:06.675816 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6ba7a6ef-7118-40b7-a3ad-38161f7abcef tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-955778878" status: 204 len: 0 microversion: 2.20 time: 0.022237 Aug 30 05:19:06.676366 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 451/871] 10.222.0.77 () {60 vars in 1259 bytes} [Tue Aug 30 05:19:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-955778878 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 05:19:08.296291 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b92a0b94-d030-4193-a103-bbb21ec8d8f4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:08.296842 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b92a0b94-d030-4193-a103-bbb21ec8d8f4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:08.303135 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b92a0b94-d030-4193-a103-bbb21ec8d8f4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:08.303620 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b92a0b94-d030-4193-a103-bbb21ec8d8f4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:08.304054 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b92a0b94-d030-4193-a103-bbb21ec8d8f4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:08.304773 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b92a0b94-d030-4193-a103-bbb21ec8d8f4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:08.305226 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b92a0b94-d030-4193-a103-bbb21ec8d8f4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:08.305649 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b92a0b94-d030-4193-a103-bbb21ec8d8f4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:08.328625 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b92a0b94-d030-4193-a103-bbb21ec8d8f4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233/ips" status: 200 len: 150 microversion: 2.1 time: 0.036868 Aug 30 05:19:08.329193 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 421/872] 10.222.0.77 () {58 vars in 1248 bytes} [Tue Aug 30 05:19:08 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:19:08.441228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5bbb321c-a8b4-4e22-a177-ff7a75f05cf8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:08.442064 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5bbb321c-a8b4-4e22-a177-ff7a75f05cf8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:08.449122 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bbb321c-a8b4-4e22-a177-ff7a75f05cf8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:08.449613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bbb321c-a8b4-4e22-a177-ff7a75f05cf8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:08.450054 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bbb321c-a8b4-4e22-a177-ff7a75f05cf8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:08.450785 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bbb321c-a8b4-4e22-a177-ff7a75f05cf8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:08.451268 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bbb321c-a8b4-4e22-a177-ff7a75f05cf8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:08.451694 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5bbb321c-a8b4-4e22-a177-ff7a75f05cf8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:08.467816 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-5bbb321c-a8b4-4e22-a177-ff7a75f05cf8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] HTTP exception thrown: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5bbb321c-a8b4-4e22-a177-ff7a75f05cf8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Request method failure captured: Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 HTTP/1.1 Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZwl_-AzLktv9UBO21qLWbSU6vb7BZkLMh5hLm0P1OlGuDZbbTyQzPWwTtQ0kxD3e-WS2lSgbqPG7l1Unj1ExmcdV6I8fixfHUk3d4jQdtzDYnuJCmZIyLv4thuTEMOgQ-d18n_gdPJooZxoEBXGRkBfZ_ADEmrEtz7X1JeFVxRKH24 Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 7ea4da0dbf3a44eabbff29f884beb157 Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:19:08.469488 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:19:08.471117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_7ea4da0dbf3a44eabbff29f884beb157", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:19:08.471117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:19:08.471117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 7ea4da0dbf3a44eabbff29f884beb157 Aug 30 05:19:08.471117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:19:08.471117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeShelveTestJSON-696047995-project Aug 30 05:19:08.471117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:19:08.471117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:19:08.471117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: 2fe451987a8c49c5b5fc0ef1c9c30ab5 Aug 30 05:19:08.471117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeShelveTestJSON-696047995-project Aug 30 05:19:08.471117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:19:08.471117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. Aug 30 05:19:08.471117 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '04bf81ed-0c85-4375-8e3b-eb18b7a48385'} Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:19:08.472022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. Aug 30 05:19:08.473285 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:08.474958 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5bbb321c-a8b4-4e22-a177-ff7a75f05cf8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Returning 404 to user: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:19:08.474958 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5bbb321c-a8b4-4e22-a177-ff7a75f05cf8 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "DELETE /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 404 len: 111 microversion: 2.20 time: 0.034645 Aug 30 05:19:08.474958 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 452/873] 10.222.0.77 () {60 vars in 1280 bytes} [Tue Aug 30 05:19:08 2022] DELETE /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 05:19:08.479779 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9c6f6ba0-d346-4aaa-8c3d-121ffa4cb6e2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:08.480549 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9c6f6ba0-d346-4aaa-8c3d-121ffa4cb6e2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 04bf81ed-0c85-4375-8e3b-eb18b7a48385] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:08.487157 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c6f6ba0-d346-4aaa-8c3d-121ffa4cb6e2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:08.487639 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c6f6ba0-d346-4aaa-8c3d-121ffa4cb6e2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:08.488289 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c6f6ba0-d346-4aaa-8c3d-121ffa4cb6e2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:08.489247 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c6f6ba0-d346-4aaa-8c3d-121ffa4cb6e2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:08.489710 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c6f6ba0-d346-4aaa-8c3d-121ffa4cb6e2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:08.490141 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9c6f6ba0-d346-4aaa-8c3d-121ffa4cb6e2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:08.504502 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-9c6f6ba0-d346-4aaa-8c3d-121ffa4cb6e2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] HTTP exception thrown: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9c6f6ba0-d346-4aaa-8c3d-121ffa4cb6e2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Request method failure captured: Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 HTTP/1.1 Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZwl_-AzLktv9UBO21qLWbSU6vb7BZkLMh5hLm0P1OlGuDZbbTyQzPWwTtQ0kxD3e-WS2lSgbqPG7l1Unj1ExmcdV6I8fixfHUk3d4jQdtzDYnuJCmZIyLv4thuTEMOgQ-d18n_gdPJooZxoEBXGRkBfZ_ADEmrEtz7X1JeFVxRKH24 Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: 7ea4da0dbf3a44eabbff29f884beb157 Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:19:08.506315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:19:08.508175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_7ea4da0dbf3a44eabbff29f884beb157", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:19:08.508175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:19:08.508175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 7ea4da0dbf3a44eabbff29f884beb157 Aug 30 05:19:08.508175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:19:08.508175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeShelveTestJSON-696047995-project Aug 30 05:19:08.508175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:19:08.508175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:19:08.508175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: 2fe451987a8c49c5b5fc0ef1c9c30ab5 Aug 30 05:19:08.508175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeShelveTestJSON-696047995-project Aug 30 05:19:08.508175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:19:08.508175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. Aug 30 05:19:08.508175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': '04bf81ed-0c85-4375-8e3b-eb18b7a48385'} Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:19:08.509562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. Aug 30 05:19:08.511166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:08.512864 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9c6f6ba0-d346-4aaa-8c3d-121ffa4cb6e2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Returning 404 to user: Instance 04bf81ed-0c85-4375-8e3b-eb18b7a48385 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:19:08.512864 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9c6f6ba0-d346-4aaa-8c3d-121ffa4cb6e2 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385" status: 404 len: 111 microversion: 2.20 time: 0.032045 Aug 30 05:19:08.512864 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 422/874] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:19:08 2022] GET /compute/v2.1/servers/04bf81ed-0c85-4375-8e3b-eb18b7a48385 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 05:19:09.650990 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dd4be817-6c7f-49ca-b49c-a3b512dd9e15 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:09.651491 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-dd4be817-6c7f-49ca-b49c-a3b512dd9e15 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:09.657850 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd4be817-6c7f-49ca-b49c-a3b512dd9e15 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:09.658329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd4be817-6c7f-49ca-b49c-a3b512dd9e15 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:09.658762 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd4be817-6c7f-49ca-b49c-a3b512dd9e15 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:09.659544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd4be817-6c7f-49ca-b49c-a3b512dd9e15 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:09.659996 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd4be817-6c7f-49ca-b49c-a3b512dd9e15 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:09.660420 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-dd4be817-6c7f-49ca-b49c-a3b512dd9e15 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:09.674062 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-dd4be817-6c7f-49ca-b49c-a3b512dd9e15 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] HTTP exception thrown: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dd4be817-6c7f-49ca-b49c-a3b512dd9e15 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Request method failure captured: Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 HTTP/1.1 Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZwl_-AzLktv9UBO21qLWbSU6vb7BZkLMh5hLm0P1OlGuDZbbTyQzPWwTtQ0kxD3e-WS2lSgbqPG7l1Unj1ExmcdV6I8fixfHUk3d4jQdtzDYnuJCmZIyLv4thuTEMOgQ-d18n_gdPJooZxoEBXGRkBfZ_ADEmrEtz7X1JeFVxRKH24 Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 7ea4da0dbf3a44eabbff29f884beb157 Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:19:09.675615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:19:09.677237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_7ea4da0dbf3a44eabbff29f884beb157", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:19:09.677237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:19:09.677237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 7ea4da0dbf3a44eabbff29f884beb157 Aug 30 05:19:09.677237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:19:09.677237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeShelveTestJSON-696047995-project Aug 30 05:19:09.677237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:19:09.677237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:19:09.677237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: 2fe451987a8c49c5b5fc0ef1c9c30ab5 Aug 30 05:19:09.677237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeShelveTestJSON-696047995-project Aug 30 05:19:09.677237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:19:09.677237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. Aug 30 05:19:09.677237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '5f83c589-3a23-45aa-96c5-3cf9006b3830'} Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:19:09.678187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. Aug 30 05:19:09.679681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:09.681299 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-dd4be817-6c7f-49ca-b49c-a3b512dd9e15 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Returning 404 to user: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:19:09.681299 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-dd4be817-6c7f-49ca-b49c-a3b512dd9e15 tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "DELETE /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 404 len: 111 microversion: 2.20 time: 0.029829 Aug 30 05:19:09.681299 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 453/875] 10.222.0.77 () {60 vars in 1280 bytes} [Tue Aug 30 05:19:09 2022] DELETE /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 05:19:09.686792 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2fd52f23-6ef3-4da7-a898-339bd6dbb30c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:09.687523 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2fd52f23-6ef3-4da7-a898-339bd6dbb30c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] [instance: 5f83c589-3a23-45aa-96c5-3cf9006b3830] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:09.693961 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fd52f23-6ef3-4da7-a898-339bd6dbb30c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:09.694515 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fd52f23-6ef3-4da7-a898-339bd6dbb30c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:09.695050 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fd52f23-6ef3-4da7-a898-339bd6dbb30c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:09.695812 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fd52f23-6ef3-4da7-a898-339bd6dbb30c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:09.696349 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fd52f23-6ef3-4da7-a898-339bd6dbb30c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:09.696779 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fd52f23-6ef3-4da7-a898-339bd6dbb30c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:09.711830 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-2fd52f23-6ef3-4da7-a898-339bd6dbb30c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] HTTP exception thrown: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2fd52f23-6ef3-4da7-a898-339bd6dbb30c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Request method failure captured: Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 HTTP/1.1 Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZwl_-AzLktv9UBO21qLWbSU6vb7BZkLMh5hLm0P1OlGuDZbbTyQzPWwTtQ0kxD3e-WS2lSgbqPG7l1Unj1ExmcdV6I8fixfHUk3d4jQdtzDYnuJCmZIyLv4thuTEMOgQ-d18n_gdPJooZxoEBXGRkBfZ_ADEmrEtz7X1JeFVxRKH24 Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: 7ea4da0dbf3a44eabbff29f884beb157 Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:19:09.713354 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:19:09.714989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/7ea4da0dbf3a44eabbff29f884beb157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_7ea4da0dbf3a44eabbff29f884beb157", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:19:09.714989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:19:09.714989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 7ea4da0dbf3a44eabbff29f884beb157 Aug 30 05:19:09.714989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-696047995 Aug 30 05:19:09.714989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeShelveTestJSON-696047995-project Aug 30 05:19:09.714989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:19:09.714989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:19:09.714989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: 2fe451987a8c49c5b5fc0ef1c9c30ab5 Aug 30 05:19:09.714989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeShelveTestJSON-696047995-project Aug 30 05:19:09.714989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:19:09.714989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. Aug 30 05:19:09.714989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': '5f83c589-3a23-45aa-96c5-3cf9006b3830'} Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:19:09.716034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. Aug 30 05:19:09.717481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:09.718588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2fd52f23-6ef3-4da7-a898-339bd6dbb30c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] Returning 404 to user: Instance 5f83c589-3a23-45aa-96c5-3cf9006b3830 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:19:09.718588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2fd52f23-6ef3-4da7-a898-339bd6dbb30c tempest-AttachVolumeShelveTestJSON-696047995 tempest-AttachVolumeShelveTestJSON-696047995-project] 10.222.0.77 "GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830" status: 404 len: 111 microversion: 2.20 time: 0.032628 Aug 30 05:19:09.718588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 423/876] 10.222.0.77 () {60 vars in 1277 bytes} [Tue Aug 30 05:19:09 2022] GET /compute/v2.1/servers/5f83c589-3a23-45aa-96c5-3cf9006b3830 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 05:19:09.735047 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-09ec6bcb-84ac-4202-b4a7-9dfbbe4da5c0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd89bd10-7ba1-46bc-a203-52fa3deccbf4"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:19:09.737717 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-09ec6bcb-84ac-4202-b4a7-9dfbbe4da5c0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:09.743848 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09ec6bcb-84ac-4202-b4a7-9dfbbe4da5c0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:09.744331 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09ec6bcb-84ac-4202-b4a7-9dfbbe4da5c0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:09.744774 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09ec6bcb-84ac-4202-b4a7-9dfbbe4da5c0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:09.745474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09ec6bcb-84ac-4202-b4a7-9dfbbe4da5c0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:09.745929 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09ec6bcb-84ac-4202-b4a7-9dfbbe4da5c0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:09.746350 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-09ec6bcb-84ac-4202-b4a7-9dfbbe4da5c0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:09.999045 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-09ec6bcb-84ac-4202-b4a7-9dfbbe4da5c0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "POST /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268400 Aug 30 05:19:09.999650 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 454/877] 10.222.0.77 () {60 vars in 1323 bytes} [Tue Aug 30 05:19:09 2022] POST /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:19:14.260043 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4e4303fe-e59b-4251-a328-c7aa8fdbb23e tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] Action: 'create', calling method: .version_select at 0x7f822ebe8280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-692283063", "metadata": {"Type": "work"}}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:19:14.542036 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4e4303fe-e59b-4251-a328-c7aa8fdbb23e tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.392505 Aug 30 05:19:14.542908 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 424/878] 10.222.0.77 () {60 vars in 1156 bytes} [Tue Aug 30 05:19:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 394 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 05:19:14.557665 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7efdf544-f465-4e78-9d0c-c09b8e8d2b3e tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] Calling method '.version_select at 0x7f8232626af0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:14.609287 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7efdf544-f465-4e78-9d0c-c09b8e8d2b3e tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117" status: 200 len: 352 microversion: 2.1 time: 0.057117 Aug 30 05:19:14.609891 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 455/879] 10.222.0.77 () {58 vars in 1245 bytes} [Tue Aug 30 05:19:14 2022] GET /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:19:15.623596 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e886736a-6649-421b-a331-5f02c37ff777 tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] Calling method '.version_select at 0x7f822ecaee50>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:15.668439 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e886736a-6649-421b-a331-5f02c37ff777 tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117" status: 200 len: 352 microversion: 2.1 time: 0.049734 Aug 30 05:19:15.669539 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 425/880] 10.222.0.77 () {58 vars in 1245 bytes} [Tue Aug 30 05:19:15 2022] GET /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:19:16.682807 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1e3a40b2-fd59-40df-9c44-1ab10bd1bd4a tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] Calling method '.version_select at 0x7f8232625ca0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:16.732469 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1e3a40b2-fd59-40df-9c44-1ab10bd1bd4a tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117" status: 200 len: 352 microversion: 2.1 time: 0.053956 Aug 30 05:19:16.733033 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 456/881] 10.222.0.77 () {58 vars in 1245 bytes} [Tue Aug 30 05:19:16 2022] GET /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117 => generated 352 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:19:17.532641 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0f3d46f2-cc53-4c09-9dbd-62e00147f4ac tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Action: 'create', calling method: .version_select at 0x7f822ed49280>, body: {"keypair": {"name": "tempest-keypair-1986712859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEWTjlvt5P2aR5B4kB2hLe1YzpGMnyG25c3vIZOCXYJuDfCZZopd4DvpReH6cf73OxbUhlhRxxHJwfkzMfIQ4Hknj5/6XFwwh1/AAre3ZL+iKdcCKUeGklmU3ShxjYZrPQ=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:19:17.548786 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-0f3d46f2-cc53-4c09-9dbd-62e00147f4ac tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Getting quotas for project bebd859c24cd4ed3b7e32a82de820b8a. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:19:17.552674 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-0f3d46f2-cc53-4c09-9dbd-62e00147f4ac tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Getting quotas for user d079e0264f0e40db9fc93b8f217a7a74 and project bebd859c24cd4ed3b7e32a82de820b8a. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:19:17.574093 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0f3d46f2-cc53-4c09-9dbd-62e00147f4ac tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046400 Aug 30 05:19:17.574708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 426/882] 10.222.0.77 () {60 vars in 1159 bytes} [Tue Aug 30 05:19:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:19:17.746726 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4eb58026-3888-42cc-9b9e-c14c46be2307 tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] Calling method '.version_select at 0x7f822ecd7670>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:17.794800 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4eb58026-3888-42cc-9b9e-c14c46be2307 tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117" status: 200 len: 353 microversion: 2.1 time: 0.052384 Aug 30 05:19:17.800413 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 457/883] 10.222.0.77 () {58 vars in 1245 bytes} [Tue Aug 30 05:19:17 2022] GET /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:19:17.807646 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6dfe1797-3b37-4354-9cff-5497490e1d90 tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] Calling method '.version_select at 0x7f822ebea280>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:17.859384 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6dfe1797-3b37-4354-9cff-5497490e1d90 tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117" status: 200 len: 353 microversion: 2.1 time: 0.055470 Aug 30 05:19:17.860036 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 427/884] 10.222.0.77 () {58 vars in 1245 bytes} [Tue Aug 30 05:19:17 2022] GET /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:19:17.873468 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c345cbfc-8102-4780-800b-0b67bb773bac tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] Calling method '.version_select at 0x7f8232625040>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:17.940313 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c345cbfc-8102-4780-800b-0b67bb773bac tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117" status: 202 len: 0 microversion: 2.1 time: 0.070718 Aug 30 05:19:17.940940 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 458/885] 10.222.0.77 () {58 vars in 1248 bytes} [Tue Aug 30 05:19:17 2022] DELETE /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:19:17.948925 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e662a766-2998-4860-99e8-a459ecc1df53 tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] Calling method '.version_select at 0x7f822ebea670>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:18.005492 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e662a766-2998-4860-99e8-a459ecc1df53 tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117" status: 200 len: 352 microversion: 2.1 time: 0.060307 Aug 30 05:19:18.006209 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 428/886] 10.222.0.77 () {58 vars in 1245 bytes} [Tue Aug 30 05:19:17 2022] GET /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:19:18.869982 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1228126368", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff2f7ffd-21e7-4f75-8a8d-ab24ee6942f2"}], "security_groups": [{"name": "tempest-securitygroup--1368594103"}], "key_name": "tempest-keypair-1986712859", "user_data": "}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:19:18.975042 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] validate_networks() for [('ff2f7ffd-21e7-4f75-8a8d-ab24ee6942f2', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:19:19.021187 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4d7d71e7-a419-4f89-a5e5-0b40dded8690 tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] Calling method '.version_select at 0x7f822ec99af0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:19.049698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-4d7d71e7-a419-4f89-a5e5-0b40dded8690 tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] HTTP exception thrown: Volume 627e1d94-a551-4390-918b-311f04e3a117 could not be found. Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4d7d71e7-a419-4f89-a5e5-0b40dded8690 tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] Request method failure captured: Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117 HTTP/1.1 Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZ3SaM8fbkSQE3QquvJA8ppZyGVpeI86DJ2_14t7USqlyypXR_JSLNc5XMP5F2br3RQWP2YUh4IArrmji0BI93j93H4kyiaNCKSo8hQfFPt0hTAsxBxI2mEbkd3pYIlIJxCpqh90v0UV0QGbDTtTn3xhg-T_CegrCV0AhvmUui9kQuQ Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: 90e437bbf3774a7daafd6fa6eaa1e00e Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesGetTestJSON-1208522425 Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:19:19.051663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:19:19.053162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/90e437bbf3774a7daafd6fa6eaa1e00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/90e437bbf3774a7daafd6fa6eaa1e00e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/90e437bbf3774a7daafd6fa6eaa1e00e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_90e437bbf3774a7daafd6fa6eaa1e00e", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:19:19.053162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesGetTestJSON-1208522425 Aug 30 05:19:19.053162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 90e437bbf3774a7daafd6fa6eaa1e00e Aug 30 05:19:19.053162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesGetTestJSON-1208522425 Aug 30 05:19:19.053162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesGetTestJSON-1208522425-project Aug 30 05:19:19.053162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:19:19.053162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:19:19.053162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: 6a00d2571c1c46ee92251172223709a9 Aug 30 05:19:19.053162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesGetTestJSON-1208522425-project Aug 30 05:19:19.053162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: Aug 30 05:19:19.053162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Volume 627e1d94-a551-4390-918b-311f04e3a117 could not be found. Aug 30 05:19:19.053162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': '627e1d94-a551-4390-918b-311f04e3a117'} Aug 30 05:19:19.053162 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 627e1d94-a551-4390-918b-311f04e3a117 could not be found. (HTTP 404) (Request-ID: req-b89c6393-c5de-412d-82af-dee98defd742) Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:19.054109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 05:19:19.055366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 627e1d94-a551-4390-918b-311f04e3a117 could not be found. Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 05:19:19.056667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:19:19.058056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 627e1d94-a551-4390-918b-311f04e3a117 could not be found. Aug 30 05:19:19.058056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:19.058056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:19.058056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:19.058056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:19.058056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:19.058056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:19.058056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:19:19.058056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:19:19.058056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 627e1d94-a551-4390-918b-311f04e3a117 could not be found. Aug 30 05:19:19.058056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:19.058056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4d7d71e7-a419-4f89-a5e5-0b40dded8690 tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] Returning 404 to user: Volume 627e1d94-a551-4390-918b-311f04e3a117 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:19:19.058056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4d7d71e7-a419-4f89-a5e5-0b40dded8690 tempest-VolumesGetTestJSON-1208522425 tempest-VolumesGetTestJSON-1208522425-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117" status: 404 len: 109 microversion: 2.1 time: 0.037717 Aug 30 05:19:19.058056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 429/887] 10.222.0.77 () {58 vars in 1245 bytes} [Tue Aug 30 05:19:19 2022] GET /compute/v2.1/os-volumes/627e1d94-a551-4390-918b-311f04e3a117 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:19:19.351481 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:19:19.351911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:19:19.352394 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:19:19.352808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:19:19.353229 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:19:19.361713 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:19.362199 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:19.362638 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:19.363416 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:19.363876 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:19.364309 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:19.381190 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Getting quotas for project bebd859c24cd4ed3b7e32a82de820b8a. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:19:19.385121 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Getting quotas for user d079e0264f0e40db9fc93b8f217a7a74 and project bebd859c24cd4ed3b7e32a82de820b8a. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:19:19.396767 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:19:19.399184 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:19:19.446672 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-82b33167-8e6c-40b3-9de2-88c5f7beea04 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.581318 Aug 30 05:19:19.447396 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 459/888] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:19:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:19:19.460323 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-274688b5-0231-464c-8b59-47ae0f422a4b tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:19.461001 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-274688b5-0231-464c-8b59-47ae0f422a4b tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:19.549183 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-274688b5-0231-464c-8b59-47ae0f422a4b tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:19.556037 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-274688b5-0231-464c-8b59-47ae0f422a4b tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1242 microversion: 2.1 time: 0.099681 Aug 30 05:19:19.568001 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 430/889] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:19 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:20.577558 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dc46d29c-6670-4a93-a83b-56d6578ecd08 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:20.578219 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dc46d29c-6670-4a93-a83b-56d6578ecd08 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:20.580170 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:20.586408 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc46d29c-6670-4a93-a83b-56d6578ecd08 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:20.586931 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc46d29c-6670-4a93-a83b-56d6578ecd08 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:20.587373 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc46d29c-6670-4a93-a83b-56d6578ecd08 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:20.588105 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc46d29c-6670-4a93-a83b-56d6578ecd08 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:20.588690 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc46d29c-6670-4a93-a83b-56d6578ecd08 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:20.589151 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc46d29c-6670-4a93-a83b-56d6578ecd08 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:20.626452 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5a0023a3-07f0-4a17-bb7d-6716c1d8b80c tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Action: 'create', calling method: .version_select at 0x7f822ecd74c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-328509599", "metadata": {"Type": "work"}}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5a0023a3-07f0-4a17-bb7d-6716c1d8b80c tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Request method failure captured: Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 121 Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZ3YXjYdTzZ3M3mYyZud5rx4EIYDXyFZzx09yNnGjKLVxIzHXzyyvAbfYBAVFkLaPKzgfToY2c4i4z2sSbN6DZF2YyHh2YWJ6GgCX1eK_dMila9H0HjeKevau4n0uboXUw3c8i-NuW2yIqC3BSeo6akwkBV7VthV_zWDqyhCSAKXsag Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 0e57e0cf02db48d387c7091122d1e1af Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:19:20.640018 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:19:20.641700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_0e57e0cf02db48d387c7091122d1e1af", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:19:20.641700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.641700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 0e57e0cf02db48d387c7091122d1e1af Aug 30 05:19:20.641700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.641700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesNegativeTest-70954643-project Aug 30 05:19:20.641700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:19:20.641700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:19:20.641700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: d44e8106431b44a48b231c6b83edfef6 Aug 30 05:19:20.641700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesNegativeTest-70954643-project Aug 30 05:19:20.641700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Aug 30 05:19:20.641700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-328509599", "metadata": {"Type": "work"}}} Aug 30 05:19:20.641700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: Aug 30 05:19:20.641700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-328509599', 'metadata': {'Type': 'work'}}}} Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise error Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:19:20.646893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 05:19:20.649060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 05:19:20.650570 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 05:19:20.650570 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.650570 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5a0023a3-07f0-4a17-bb7d-6716c1d8b80c tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:19:20.650570 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5a0023a3-07f0-4a17-bb7d-6716c1d8b80c tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.133438 Aug 30 05:19:20.650570 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 460/890] 10.222.0.77 () {60 vars in 1156 bytes} [Tue Aug 30 05:19:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 05:19:20.652687 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-13b45c98-9a0d-4949-9301-e70108f0f8b0 tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Action: 'create', calling method: .version_select at 0x7f822ed46af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1249297717", "metadata": {"Type": "work"}}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:19:20.654138 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dc46d29c-6670-4a93-a83b-56d6578ecd08 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-13b45c98-9a0d-4949-9301-e70108f0f8b0 tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Request method failure captured: Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 120 Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZ3YXjYdTzZ3M3mYyZud5rx4EIYDXyFZzx09yNnGjKLVxIzHXzyyvAbfYBAVFkLaPKzgfToY2c4i4z2sSbN6DZF2YyHh2YWJ6GgCX1eK_dMila9H0HjeKevau4n0uboXUw3c8i-NuW2yIqC3BSeo6akwkBV7VthV_zWDqyhCSAKXsag Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 0e57e0cf02db48d387c7091122d1e1af Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:19:20.656474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:19:20.657979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_0e57e0cf02db48d387c7091122d1e1af", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:19:20.657979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.657979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 0e57e0cf02db48d387c7091122d1e1af Aug 30 05:19:20.657979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.657979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesNegativeTest-70954643-project Aug 30 05:19:20.657979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:19:20.657979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:19:20.657979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: d44e8106431b44a48b231c6b83edfef6 Aug 30 05:19:20.657979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesNegativeTest-70954643-project Aug 30 05:19:20.657979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Aug 30 05:19:20.657979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1249297717", "metadata": {"Type": "work"}}} Aug 30 05:19:20.657979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: Aug 30 05:19:20.657979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1249297717', 'metadata': {'Type': 'work'}}}} Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise error Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi '0' Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:19:20.658960 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 05:19:20.660560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 05:19:20.661913 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 05:19:20.661913 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.661913 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-13b45c98-9a0d-4949-9301-e70108f0f8b0 tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:19:20.661913 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-13b45c98-9a0d-4949-9301-e70108f0f8b0 tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009049 Aug 30 05:19:20.661913 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 461/891] 10.222.0.77 () {60 vars in 1156 bytes} [Tue Aug 30 05:19:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 05:19:20.662277 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dc46d29c-6670-4a93-a83b-56d6578ecd08 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1302 microversion: 2.1 time: 0.089064 Aug 30 05:19:20.662712 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 431/892] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:20 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1302 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:19:20.672175 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-08a03f29-61c5-473e-b535-633ddba0e922 tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Action: 'create', calling method: .version_select at 0x7f822ecac280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-316343745", "metadata": {"Type": "work"}}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-08a03f29-61c5-473e-b535-633ddba0e922 tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Request method failure captured: Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 118 Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZ3YXjYdTzZ3M3mYyZud5rx4EIYDXyFZzx09yNnGjKLVxIzHXzyyvAbfYBAVFkLaPKzgfToY2c4i4z2sSbN6DZF2YyHh2YWJ6GgCX1eK_dMila9H0HjeKevau4n0uboXUw3c8i-NuW2yIqC3BSeo6akwkBV7VthV_zWDqyhCSAKXsag Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 0e57e0cf02db48d387c7091122d1e1af Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:19:20.675648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:19:20.677289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_0e57e0cf02db48d387c7091122d1e1af", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:19:20.677289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.677289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 0e57e0cf02db48d387c7091122d1e1af Aug 30 05:19:20.677289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.677289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesNegativeTest-70954643-project Aug 30 05:19:20.677289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:19:20.677289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:19:20.677289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: d44e8106431b44a48b231c6b83edfef6 Aug 30 05:19:20.677289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesNegativeTest-70954643-project Aug 30 05:19:20.677289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Aug 30 05:19:20.677289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-316343745", "metadata": {"Type": "work"}}} Aug 30 05:19:20.677289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: Aug 30 05:19:20.677289 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-316343745', 'metadata': {'Type': 'work'}}}} Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise error Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi '' Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:19:20.678329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 05:19:20.679944 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 05:19:20.681305 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 05:19:20.681305 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.681305 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-08a03f29-61c5-473e-b535-633ddba0e922 tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:19:20.681305 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-08a03f29-61c5-473e-b535-633ddba0e922 tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] 10.222.0.77 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008462 Aug 30 05:19:20.681305 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 462/893] 10.222.0.77 () {60 vars in 1156 bytes} [Tue Aug 30 05:19:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 05:19:20.685639 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c0d513e6-9f1e-474c-9a3d-1a373a8aaf2a tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Calling method '.version_select at 0x7f822ebea670>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:20.714429 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-c0d513e6-9f1e-474c-9a3d-1a373a8aaf2a tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] HTTP exception thrown: Volume tempest-invalid-1071113182 could not be found. Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c0d513e6-9f1e-474c-9a3d-1a373a8aaf2a tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Request method failure captured: Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1071113182 HTTP/1.1 Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZ3YXjYdTzZ3M3mYyZud5rx4EIYDXyFZzx09yNnGjKLVxIzHXzyyvAbfYBAVFkLaPKzgfToY2c4i4z2sSbN6DZF2YyHh2YWJ6GgCX1eK_dMila9H0HjeKevau4n0uboXUw3c8i-NuW2yIqC3BSeo6akwkBV7VthV_zWDqyhCSAKXsag Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: 0e57e0cf02db48d387c7091122d1e1af Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:19:20.716602 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:19:20.718199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_0e57e0cf02db48d387c7091122d1e1af", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:19:20.718199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.718199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 0e57e0cf02db48d387c7091122d1e1af Aug 30 05:19:20.718199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.718199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesNegativeTest-70954643-project Aug 30 05:19:20.718199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:19:20.718199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:19:20.718199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: d44e8106431b44a48b231c6b83edfef6 Aug 30 05:19:20.718199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesNegativeTest-70954643-project Aug 30 05:19:20.718199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: Aug 30 05:19:20.718199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Volume tempest-invalid-1071113182 could not be found. Aug 30 05:19:20.718199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': 'tempest-invalid-1071113182'} Aug 30 05:19:20.718199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1071113182 could not be found. (HTTP 404) (Request-ID: req-222092e2-8288-4a17-9ded-6136c0ed1863) Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:20.719150 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 05:19:20.720597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1071113182 could not be found. Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:19:20.721958 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1071113182 could not be found. Aug 30 05:19:20.723547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.723547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:20.723547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.723547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.723547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:20.723547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:20.723547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:19:20.723547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:19:20.723547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1071113182 could not be found. Aug 30 05:19:20.723547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.723547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c0d513e6-9f1e-474c-9a3d-1a373a8aaf2a tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Returning 404 to user: Volume tempest-invalid-1071113182 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:19:20.723547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c0d513e6-9f1e-474c-9a3d-1a373a8aaf2a tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1071113182" status: 404 len: 99 microversion: 2.1 time: 0.035969 Aug 30 05:19:20.723547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 432/894] 10.222.0.77 () {58 vars in 1218 bytes} [Tue Aug 30 05:19:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1071113182 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 05:19:20.729583 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-859c98fd-ceb2-47af-8813-e3a1214448f7 tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005879 Aug 30 05:19:20.730082 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 463/895] 10.222.0.77 () {58 vars in 1140 bytes} [Tue Aug 30 05:19:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 05:19:20.738332 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bcadaed7-f171-4f80-a1ca-24c11fb1b681 tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003608 Aug 30 05:19:20.738841 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 433/896] 10.222.0.77 () {58 vars in 1137 bytes} [Tue Aug 30 05:19:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 05:19:20.747212 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f5944542-68ae-4016-b369-de9ac141b0fa tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Calling method '.version_select at 0x7f82325ba3a0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:20.775210 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-f5944542-68ae-4016-b369-de9ac141b0fa tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] HTTP exception thrown: Volume f8eb442b-943b-4394-b989-9f12fddfdcb4 could not be found. Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f5944542-68ae-4016-b369-de9ac141b0fa tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Request method failure captured: Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/os-volumes/f8eb442b-943b-4394-b989-9f12fddfdcb4 HTTP/1.1 Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZ3YXjYdTzZ3M3mYyZud5rx4EIYDXyFZzx09yNnGjKLVxIzHXzyyvAbfYBAVFkLaPKzgfToY2c4i4z2sSbN6DZF2YyHh2YWJ6GgCX1eK_dMila9H0HjeKevau4n0uboXUw3c8i-NuW2yIqC3BSeo6akwkBV7VthV_zWDqyhCSAKXsag Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 0e57e0cf02db48d387c7091122d1e1af Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:19:20.777120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:19:20.778640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_0e57e0cf02db48d387c7091122d1e1af", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:19:20.778640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.778640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 0e57e0cf02db48d387c7091122d1e1af Aug 30 05:19:20.778640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.778640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-VolumesNegativeTest-70954643-project Aug 30 05:19:20.778640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:19:20.778640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:19:20.778640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: d44e8106431b44a48b231c6b83edfef6 Aug 30 05:19:20.778640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-VolumesNegativeTest-70954643-project Aug 30 05:19:20.778640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: Aug 30 05:19:20.778640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Volume f8eb442b-943b-4394-b989-9f12fddfdcb4 could not be found. Aug 30 05:19:20.778640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': 'f8eb442b-943b-4394-b989-9f12fddfdcb4'} Aug 30 05:19:20.778640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f8eb442b-943b-4394-b989-9f12fddfdcb4 could not be found. (HTTP 404) (Request-ID: req-1c724e3b-cf50-40d5-b722-54e0fb2a505a) Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:20.779632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 05:19:20.780983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f8eb442b-943b-4394-b989-9f12fddfdcb4 could not be found. Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 05:19:20.782180 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:19:20.783611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f8eb442b-943b-4394-b989-9f12fddfdcb4 could not be found. Aug 30 05:19:20.783611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.783611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:20.783611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.783611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.783611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:20.783611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:20.783611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:19:20.783611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:19:20.783611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f8eb442b-943b-4394-b989-9f12fddfdcb4 could not be found. Aug 30 05:19:20.783611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.783611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f5944542-68ae-4016-b369-de9ac141b0fa tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Returning 404 to user: Volume f8eb442b-943b-4394-b989-9f12fddfdcb4 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:19:20.783611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f5944542-68ae-4016-b369-de9ac141b0fa tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] 10.222.0.77 "DELETE /compute/v2.1/os-volumes/f8eb442b-943b-4394-b989-9f12fddfdcb4" status: 404 len: 109 microversion: 2.1 time: 0.034775 Aug 30 05:19:20.783611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 464/897] 10.222.0.77 () {58 vars in 1248 bytes} [Tue Aug 30 05:19:20 2022] DELETE /compute/v2.1/os-volumes/f8eb442b-943b-4394-b989-9f12fddfdcb4 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:19:20.787838 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-566de957-9609-4ec8-9f0e-c234d9bb736d tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Calling method '.version_select at 0x7f822ebf4550>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:20.815574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-566de957-9609-4ec8-9f0e-c234d9bb736d tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] HTTP exception thrown: Volume 392233cc-7fe9-4a6a-aa80-ceafcd2bd34e could not be found. Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-566de957-9609-4ec8-9f0e-c234d9bb736d tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Request method failure captured: Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/os-volumes/392233cc-7fe9-4a6a-aa80-ceafcd2bd34e HTTP/1.1 Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZ3YXjYdTzZ3M3mYyZud5rx4EIYDXyFZzx09yNnGjKLVxIzHXzyyvAbfYBAVFkLaPKzgfToY2c4i4z2sSbN6DZF2YyHh2YWJ6GgCX1eK_dMila9H0HjeKevau4n0uboXUw3c8i-NuW2yIqC3BSeo6akwkBV7VthV_zWDqyhCSAKXsag Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: 0e57e0cf02db48d387c7091122d1e1af Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:19:20.817574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:19:20.819126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/0e57e0cf02db48d387c7091122d1e1af"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_0e57e0cf02db48d387c7091122d1e1af", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:19:20.819126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.819126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 0e57e0cf02db48d387c7091122d1e1af Aug 30 05:19:20.819126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-VolumesNegativeTest-70954643 Aug 30 05:19:20.819126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-VolumesNegativeTest-70954643-project Aug 30 05:19:20.819126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:19:20.819126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:19:20.819126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: d44e8106431b44a48b231c6b83edfef6 Aug 30 05:19:20.819126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-VolumesNegativeTest-70954643-project Aug 30 05:19:20.819126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: Aug 30 05:19:20.819126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Volume 392233cc-7fe9-4a6a-aa80-ceafcd2bd34e could not be found. Aug 30 05:19:20.819126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': '392233cc-7fe9-4a6a-aa80-ceafcd2bd34e'} Aug 30 05:19:20.819126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 392233cc-7fe9-4a6a-aa80-ceafcd2bd34e could not be found. (HTTP 404) (Request-ID: req-4aa6fbb2-8857-4f1b-8d91-37d5ec6ccf0e) Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:20.820164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 05:19:20.821536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 392233cc-7fe9-4a6a-aa80-ceafcd2bd34e could not be found. Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 05:19:20.822929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:19:20.824336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 392233cc-7fe9-4a6a-aa80-ceafcd2bd34e could not be found. Aug 30 05:19:20.824336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.824336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:19:20.824336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.824336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:19:20.824336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:19:20.824336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:19:20.824336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:19:20.824336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:19:20.824336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 392233cc-7fe9-4a6a-aa80-ceafcd2bd34e could not be found. Aug 30 05:19:20.824336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:19:20.824336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-566de957-9609-4ec8-9f0e-c234d9bb736d tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] Returning 404 to user: Volume 392233cc-7fe9-4a6a-aa80-ceafcd2bd34e could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:19:20.824336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-566de957-9609-4ec8-9f0e-c234d9bb736d tempest-VolumesNegativeTest-70954643 tempest-VolumesNegativeTest-70954643-project] 10.222.0.77 "GET /compute/v2.1/os-volumes/392233cc-7fe9-4a6a-aa80-ceafcd2bd34e" status: 404 len: 109 microversion: 2.1 time: 0.034861 Aug 30 05:19:20.824336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 434/898] 10.222.0.77 () {58 vars in 1245 bytes} [Tue Aug 30 05:19:20 2022] GET /compute/v2.1/os-volumes/392233cc-7fe9-4a6a-aa80-ceafcd2bd34e => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:19:21.682986 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3a77059c-3421-49f4-a310-08f5f68c4b7e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:21.683607 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3a77059c-3421-49f4-a310-08f5f68c4b7e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:21.690708 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a77059c-3421-49f4-a310-08f5f68c4b7e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:21.691232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a77059c-3421-49f4-a310-08f5f68c4b7e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:21.691668 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a77059c-3421-49f4-a310-08f5f68c4b7e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:21.692368 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a77059c-3421-49f4-a310-08f5f68c4b7e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:21.692819 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a77059c-3421-49f4-a310-08f5f68c4b7e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:21.693425 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3a77059c-3421-49f4-a310-08f5f68c4b7e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:21.756828 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3a77059c-3421-49f4-a310-08f5f68c4b7e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:21.765658 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3a77059c-3421-49f4-a310-08f5f68c4b7e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1302 microversion: 2.1 time: 0.087024 Aug 30 05:19:21.766209 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 465/899] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:21 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1302 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:22.785757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9aaf7c22-a816-4461-a490-fbc5bdadb0a3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:22.786375 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9aaf7c22-a816-4461-a490-fbc5bdadb0a3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:22.792523 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9aaf7c22-a816-4461-a490-fbc5bdadb0a3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:22.793578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9aaf7c22-a816-4461-a490-fbc5bdadb0a3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:22.794070 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9aaf7c22-a816-4461-a490-fbc5bdadb0a3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:22.794840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9aaf7c22-a816-4461-a490-fbc5bdadb0a3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:22.795930 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9aaf7c22-a816-4461-a490-fbc5bdadb0a3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:22.796469 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9aaf7c22-a816-4461-a490-fbc5bdadb0a3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:22.860207 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9aaf7c22-a816-4461-a490-fbc5bdadb0a3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:22.867945 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9aaf7c22-a816-4461-a490-fbc5bdadb0a3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1302 microversion: 2.1 time: 0.086493 Aug 30 05:19:22.868505 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 435/900] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:22 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1302 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:23.888956 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f849aec2-2449-411d-bc45-fe9985c4127e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:23.890277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f849aec2-2449-411d-bc45-fe9985c4127e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:23.896629 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f849aec2-2449-411d-bc45-fe9985c4127e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:23.897106 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f849aec2-2449-411d-bc45-fe9985c4127e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:23.897537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f849aec2-2449-411d-bc45-fe9985c4127e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:23.898223 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f849aec2-2449-411d-bc45-fe9985c4127e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:23.898677 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f849aec2-2449-411d-bc45-fe9985c4127e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:23.899126 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f849aec2-2449-411d-bc45-fe9985c4127e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:23.977556 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f849aec2-2449-411d-bc45-fe9985c4127e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:23.985499 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f849aec2-2449-411d-bc45-fe9985c4127e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1300 microversion: 2.1 time: 0.100410 Aug 30 05:19:23.986156 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 466/901] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:23 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1300 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:25.005575 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3e0c86c1-e458-43af-ae9d-1ab537ee7412 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:25.006128 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3e0c86c1-e458-43af-ae9d-1ab537ee7412 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:25.013041 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e0c86c1-e458-43af-ae9d-1ab537ee7412 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:25.013530 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e0c86c1-e458-43af-ae9d-1ab537ee7412 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:25.013993 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e0c86c1-e458-43af-ae9d-1ab537ee7412 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:25.015469 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e0c86c1-e458-43af-ae9d-1ab537ee7412 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:25.015989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e0c86c1-e458-43af-ae9d-1ab537ee7412 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:25.016651 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3e0c86c1-e458-43af-ae9d-1ab537ee7412 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:25.114039 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-9564ec4f-ac22-429d-803e-13b8530b4038 req-34ba22a8-d8ac-4051-ad7f-d6def653dd6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4766e8f6-4e42-4773-bb22-b725770d2487", "tag": "08c74dd1-5956-4921-97d8-5fa4c04b4949"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:19:25.127954 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-9564ec4f-ac22-429d-803e-13b8530b4038 req-34ba22a8-d8ac-4051-ad7f-d6def653dd6a service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:25.129288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-9564ec4f-ac22-429d-803e-13b8530b4038 req-34ba22a8-d8ac-4051-ad7f-d6def653dd6a service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:25.130257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-9564ec4f-ac22-429d-803e-13b8530b4038 req-34ba22a8-d8ac-4051-ad7f-d6def653dd6a service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:25.144292 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-9564ec4f-ac22-429d-803e-13b8530b4038 req-34ba22a8-d8ac-4051-ad7f-d6def653dd6a service nova] Creating event network-changed:08c74dd1-5956-4921-97d8-5fa4c04b4949 for instance 4766e8f6-4e42-4773-bb22-b725770d2487 on hv-cinder-85391 Aug 30 05:19:25.160812 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-9564ec4f-ac22-429d-803e-13b8530b4038 req-34ba22a8-d8ac-4051-ad7f-d6def653dd6a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050622 Aug 30 05:19:25.161947 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 467/902] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:19:25.177397 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3e0c86c1-e458-43af-ae9d-1ab537ee7412 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:25.185228 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3e0c86c1-e458-43af-ae9d-1ab537ee7412 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1368 microversion: 2.1 time: 0.183528 Aug 30 05:19:25.186705 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 436/903] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:25 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:26.206012 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f855ba00-28b6-495b-a9f5-97115f6d4ed4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:26.206736 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f855ba00-28b6-495b-a9f5-97115f6d4ed4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:26.213348 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f855ba00-28b6-495b-a9f5-97115f6d4ed4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:26.213827 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f855ba00-28b6-495b-a9f5-97115f6d4ed4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:26.214260 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f855ba00-28b6-495b-a9f5-97115f6d4ed4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:26.214976 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f855ba00-28b6-495b-a9f5-97115f6d4ed4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:26.215707 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f855ba00-28b6-495b-a9f5-97115f6d4ed4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:26.216132 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f855ba00-28b6-495b-a9f5-97115f6d4ed4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:26.352643 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f855ba00-28b6-495b-a9f5-97115f6d4ed4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:26.360587 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f855ba00-28b6-495b-a9f5-97115f6d4ed4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1368 microversion: 2.1 time: 0.158845 Aug 30 05:19:26.361156 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 468/904] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:26 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:27.381403 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d065731a-0ade-4ccd-8773-ab87b20e7ceb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:27.382018 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d065731a-0ade-4ccd-8773-ab87b20e7ceb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:27.388281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d065731a-0ade-4ccd-8773-ab87b20e7ceb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:27.388759 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d065731a-0ade-4ccd-8773-ab87b20e7ceb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:27.389190 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d065731a-0ade-4ccd-8773-ab87b20e7ceb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:27.389873 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d065731a-0ade-4ccd-8773-ab87b20e7ceb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:27.390323 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d065731a-0ade-4ccd-8773-ab87b20e7ceb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:27.390772 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d065731a-0ade-4ccd-8773-ab87b20e7ceb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:27.522510 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d065731a-0ade-4ccd-8773-ab87b20e7ceb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:27.530479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d065731a-0ade-4ccd-8773-ab87b20e7ceb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1368 microversion: 2.1 time: 0.152480 Aug 30 05:19:27.531069 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 437/905] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:27 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:28.550800 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-70eab84d-f5d1-49ab-b150-5712c90d21f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:28.551453 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-70eab84d-f5d1-49ab-b150-5712c90d21f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:28.557915 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70eab84d-f5d1-49ab-b150-5712c90d21f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:28.558399 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70eab84d-f5d1-49ab-b150-5712c90d21f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:28.558868 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70eab84d-f5d1-49ab-b150-5712c90d21f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:28.559567 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70eab84d-f5d1-49ab-b150-5712c90d21f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:28.560028 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70eab84d-f5d1-49ab-b150-5712c90d21f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:28.560463 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-70eab84d-f5d1-49ab-b150-5712c90d21f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:28.685655 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-70eab84d-f5d1-49ab-b150-5712c90d21f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:28.693796 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-70eab84d-f5d1-49ab-b150-5712c90d21f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1368 microversion: 2.1 time: 0.146926 Aug 30 05:19:28.694362 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 469/906] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:28 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:29.714787 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a87b37bc-4642-40e0-b556-5cac5adbc580 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:29.715726 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a87b37bc-4642-40e0-b556-5cac5adbc580 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:29.718116 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=6 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:29.723427 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a87b37bc-4642-40e0-b556-5cac5adbc580 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:29.723919 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a87b37bc-4642-40e0-b556-5cac5adbc580 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:29.724360 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a87b37bc-4642-40e0-b556-5cac5adbc580 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:29.725058 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a87b37bc-4642-40e0-b556-5cac5adbc580 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:29.725518 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a87b37bc-4642-40e0-b556-5cac5adbc580 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:29.725942 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a87b37bc-4642-40e0-b556-5cac5adbc580 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:29.862168 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a87b37bc-4642-40e0-b556-5cac5adbc580 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:29.870208 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a87b37bc-4642-40e0-b556-5cac5adbc580 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1368 microversion: 2.1 time: 0.159660 Aug 30 05:19:29.870776 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 438/907] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:29 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:30.891952 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f541d91a-f98a-4ea2-b6db-f3de202e7c56 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:30.892565 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f541d91a-f98a-4ea2-b6db-f3de202e7c56 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:30.895570 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:30.896420 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:30.902625 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f541d91a-f98a-4ea2-b6db-f3de202e7c56 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:30.903232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f541d91a-f98a-4ea2-b6db-f3de202e7c56 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:30.903735 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f541d91a-f98a-4ea2-b6db-f3de202e7c56 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:30.904651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f541d91a-f98a-4ea2-b6db-f3de202e7c56 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:30.905900 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f541d91a-f98a-4ea2-b6db-f3de202e7c56 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:30.906585 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f541d91a-f98a-4ea2-b6db-f3de202e7c56 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:31.212398 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f541d91a-f98a-4ea2-b6db-f3de202e7c56 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:31.225677 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f541d91a-f98a-4ea2-b6db-f3de202e7c56 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1368 microversion: 2.1 time: 0.337959 Aug 30 05:19:31.227547 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 470/908] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:30 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1368 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:19:32.246293 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-66193e01-dc09-45e9-bd71-71b3e0383677 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:32.247070 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-66193e01-dc09-45e9-bd71-71b3e0383677 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:32.253803 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66193e01-dc09-45e9-bd71-71b3e0383677 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:32.254285 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66193e01-dc09-45e9-bd71-71b3e0383677 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:32.254723 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66193e01-dc09-45e9-bd71-71b3e0383677 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:32.255478 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66193e01-dc09-45e9-bd71-71b3e0383677 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:32.255931 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66193e01-dc09-45e9-bd71-71b3e0383677 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:32.256351 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-66193e01-dc09-45e9-bd71-71b3e0383677 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:32.384407 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-66193e01-dc09-45e9-bd71-71b3e0383677 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:32.393046 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-66193e01-dc09-45e9-bd71-71b3e0383677 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1368 microversion: 2.1 time: 0.150892 Aug 30 05:19:32.393613 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 439/909] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:32 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:33.416825 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3874fcfd-3f8b-4957-b56f-b4d4bba7969c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:33.418385 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3874fcfd-3f8b-4957-b56f-b4d4bba7969c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:33.422058 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:33.438727 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3874fcfd-3f8b-4957-b56f-b4d4bba7969c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:33.440547 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3874fcfd-3f8b-4957-b56f-b4d4bba7969c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:33.441193 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3874fcfd-3f8b-4957-b56f-b4d4bba7969c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:33.442267 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3874fcfd-3f8b-4957-b56f-b4d4bba7969c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:33.442992 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3874fcfd-3f8b-4957-b56f-b4d4bba7969c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:33.443815 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3874fcfd-3f8b-4957-b56f-b4d4bba7969c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:33.476850 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:33.492263 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-966dda3b-34e5-457a-aea2-a07aa5b3d151 req-861276c3-6f7c-4572-a9e5-7971cd61399f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4766e8f6-4e42-4773-bb22-b725770d2487", "name": "network-vif-plugged", "status": "completed", "tag": "08c74dd1-5956-4921-97d8-5fa4c04b4949"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:19:33.501938 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:33.506384 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-966dda3b-34e5-457a-aea2-a07aa5b3d151 req-861276c3-6f7c-4572-a9e5-7971cd61399f service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:33.507269 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-966dda3b-34e5-457a-aea2-a07aa5b3d151 req-861276c3-6f7c-4572-a9e5-7971cd61399f service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:33.507767 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-966dda3b-34e5-457a-aea2-a07aa5b3d151 req-861276c3-6f7c-4572-a9e5-7971cd61399f service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:33.520906 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-966dda3b-34e5-457a-aea2-a07aa5b3d151 req-861276c3-6f7c-4572-a9e5-7971cd61399f service nova] Creating event network-vif-plugged:08c74dd1-5956-4921-97d8-5fa4c04b4949 for instance 4766e8f6-4e42-4773-bb22-b725770d2487 on hv-cinder-85391 Aug 30 05:19:33.526731 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-966dda3b-34e5-457a-aea2-a07aa5b3d151 req-861276c3-6f7c-4572-a9e5-7971cd61399f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038710 Aug 30 05:19:33.527481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 440/910] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:19:34.026563 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3874fcfd-3f8b-4957-b56f-b4d4bba7969c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:34.038899 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3874fcfd-3f8b-4957-b56f-b4d4bba7969c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1368 microversion: 2.1 time: 0.627047 Aug 30 05:19:34.054471 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 471/911] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:33 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1368 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:35.062090 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0b01c5c9-775e-4c44-8c9f-aa57795d1fa7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:35.063687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0b01c5c9-775e-4c44-8c9f-aa57795d1fa7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:35.079768 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b01c5c9-775e-4c44-8c9f-aa57795d1fa7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:35.080392 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b01c5c9-775e-4c44-8c9f-aa57795d1fa7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:35.080910 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b01c5c9-775e-4c44-8c9f-aa57795d1fa7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:35.081877 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b01c5c9-775e-4c44-8c9f-aa57795d1fa7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:35.082426 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b01c5c9-775e-4c44-8c9f-aa57795d1fa7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:35.083097 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0b01c5c9-775e-4c44-8c9f-aa57795d1fa7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:35.281818 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-0b01c5c9-775e-4c44-8c9f-aa57795d1fa7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:35.293260 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0b01c5c9-775e-4c44-8c9f-aa57795d1fa7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1368 microversion: 2.1 time: 0.235427 Aug 30 05:19:35.294092 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 441/912] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:35 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:36.314803 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e30c8add-12fd-432d-8c1c-521e2901928c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:36.315457 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e30c8add-12fd-432d-8c1c-521e2901928c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:36.322436 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e30c8add-12fd-432d-8c1c-521e2901928c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:36.323176 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e30c8add-12fd-432d-8c1c-521e2901928c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:36.323871 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e30c8add-12fd-432d-8c1c-521e2901928c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:36.324747 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e30c8add-12fd-432d-8c1c-521e2901928c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:36.325111 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e30c8add-12fd-432d-8c1c-521e2901928c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:36.328143 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e30c8add-12fd-432d-8c1c-521e2901928c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:36.536138 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e30c8add-12fd-432d-8c1c-521e2901928c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:36.544518 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e30c8add-12fd-432d-8c1c-521e2901928c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1558 microversion: 2.1 time: 0.233548 Aug 30 05:19:36.545772 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 472/913] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:36 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1558 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:36.567258 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fd16b31a-7ca0-4313-a39e-5bf8410a4725 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:36.567863 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fd16b31a-7ca0-4313-a39e-5bf8410a4725 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:36.577195 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd16b31a-7ca0-4313-a39e-5bf8410a4725 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:36.578137 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd16b31a-7ca0-4313-a39e-5bf8410a4725 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:36.578740 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd16b31a-7ca0-4313-a39e-5bf8410a4725 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:36.580471 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd16b31a-7ca0-4313-a39e-5bf8410a4725 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:36.581427 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd16b31a-7ca0-4313-a39e-5bf8410a4725 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:36.582024 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fd16b31a-7ca0-4313-a39e-5bf8410a4725 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:36.705365 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fd16b31a-7ca0-4313-a39e-5bf8410a4725 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143088 Aug 30 05:19:36.712902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 442/914] 10.222.0.77 () {58 vars in 1275 bytes} [Tue Aug 30 05:19:36 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:19:38.443240 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-02cd3b7d-cc07-49bd-81f4-ed8f4b52c66a req-d38a3f2d-af8a-4830-9762-d5198c93e227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4766e8f6-4e42-4773-bb22-b725770d2487", "tag": "08c74dd1-5956-4921-97d8-5fa4c04b4949"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:19:38.469858 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-02cd3b7d-cc07-49bd-81f4-ed8f4b52c66a req-d38a3f2d-af8a-4830-9762-d5198c93e227 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:38.470135 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-02cd3b7d-cc07-49bd-81f4-ed8f4b52c66a req-d38a3f2d-af8a-4830-9762-d5198c93e227 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:38.470575 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-02cd3b7d-cc07-49bd-81f4-ed8f4b52c66a req-d38a3f2d-af8a-4830-9762-d5198c93e227 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:38.483873 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-02cd3b7d-cc07-49bd-81f4-ed8f4b52c66a req-d38a3f2d-af8a-4830-9762-d5198c93e227 service nova] Creating event network-changed:08c74dd1-5956-4921-97d8-5fa4c04b4949 for instance 4766e8f6-4e42-4773-bb22-b725770d2487 on hv-cinder-85391 Aug 30 05:19:38.492987 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-02cd3b7d-cc07-49bd-81f4-ed8f4b52c66a req-d38a3f2d-af8a-4830-9762-d5198c93e227 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057128 Aug 30 05:19:38.494059 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 473/915] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:19:50.945437 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=5 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:50.946206 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=48 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:50.950053 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b87f1562-5373-4afc-8a8f-678879298f9c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Action: 'create', calling method: .version_select at 0x7f822ec995e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-920382813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ+Ze42ZD/DPvkQrgPnLCNfHq6qet645uypgmhrfIU7qUFZOBBuYOSoCyYZy8ybAtR8vFtAOLWc8R0NFmi+sMgoCJ7ymGHeUyc7nD3zz4yiQZUWEArExnuehw6itEjDUQ=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:19:50.966182 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-b87f1562-5373-4afc-8a8f-678879298f9c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Getting quotas for project 4826d4507ffc4e3288aac00b1409ea46. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:19:50.970659 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-b87f1562-5373-4afc-8a8f-678879298f9c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Getting quotas for user b92e3e3eff1e40d38fdfc68e467367f7 and project 4826d4507ffc4e3288aac00b1409ea46. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:19:50.992362 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b87f1562-5373-4afc-8a8f-678879298f9c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.048351 Aug 30 05:19:50.993266 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 443/916] 10.222.0.77 () {60 vars in 1159 bytes} [Tue Aug 30 05:19:50 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:19:51.042447 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=5 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:51.043204 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=13 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:51.047688 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1466873657", "imageRef": "17df2ea5-4507-4c4a-8692-88fab878d899", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-920382813", "networks": [{"uuid": "26f31fdb-da8e-4338-8261-3d7497337796"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:19:51.102223 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] validate_networks() for [('26f31fdb-da8e-4338-8261-3d7497337796', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:19:51.471736 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:19:51.472160 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:19:51.472632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:19:51.473044 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:19:51.473454 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:19:51.482368 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:51.482886 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:51.483325 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:51.484046 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:51.484526 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:51.484945 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:51.501660 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Getting quotas for project 4826d4507ffc4e3288aac00b1409ea46. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:19:51.505469 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Getting quotas for user b92e3e3eff1e40d38fdfc68e467367f7 and project 4826d4507ffc4e3288aac00b1409ea46. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:19:51.516613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:19:51.518924 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='17df2ea5-4507-4c4a-8692-88fab878d899',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:19:51.563464 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1e80f71b-dc13-4e05-ab43-b710ed1c1363 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522745 Aug 30 05:19:51.564136 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 474/917] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:19:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:19:51.575058 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7315278d-6c80-41ae-8695-4ca943efd4f8 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:51.575805 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7315278d-6c80-41ae-8695-4ca943efd4f8 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:51.630806 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7315278d-6c80-41ae-8695-4ca943efd4f8 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:51.639141 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7315278d-6c80-41ae-8695-4ca943efd4f8 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1258 microversion: 2.1 time: 0.067409 Aug 30 05:19:51.639784 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 444/918] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:51 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:52.661766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-043a91b2-b17b-4193-b431-2be5b0e343a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:52.663080 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-043a91b2-b17b-4193-b431-2be5b0e343a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:52.669249 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-043a91b2-b17b-4193-b431-2be5b0e343a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:52.669808 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-043a91b2-b17b-4193-b431-2be5b0e343a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:52.670294 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-043a91b2-b17b-4193-b431-2be5b0e343a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:52.671276 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-043a91b2-b17b-4193-b431-2be5b0e343a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:52.671795 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-043a91b2-b17b-4193-b431-2be5b0e343a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:52.672283 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-043a91b2-b17b-4193-b431-2be5b0e343a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:52.746178 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-043a91b2-b17b-4193-b431-2be5b0e343a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:52.754843 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-043a91b2-b17b-4193-b431-2be5b0e343a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1318 microversion: 2.1 time: 0.097583 Aug 30 05:19:52.755474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 475/919] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:52 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1318 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:53.776790 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-75a2468f-89c6-4ff5-823e-96f11d59b6a6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:53.777438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-75a2468f-89c6-4ff5-823e-96f11d59b6a6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:53.785103 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75a2468f-89c6-4ff5-823e-96f11d59b6a6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:53.786941 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75a2468f-89c6-4ff5-823e-96f11d59b6a6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:53.787535 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75a2468f-89c6-4ff5-823e-96f11d59b6a6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:53.788817 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75a2468f-89c6-4ff5-823e-96f11d59b6a6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:53.789438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75a2468f-89c6-4ff5-823e-96f11d59b6a6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:53.789897 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-75a2468f-89c6-4ff5-823e-96f11d59b6a6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:53.976107 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-75a2468f-89c6-4ff5-823e-96f11d59b6a6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:53.984317 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-75a2468f-89c6-4ff5-823e-96f11d59b6a6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.211604 Aug 30 05:19:53.984898 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 445/920] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:53 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:55.004984 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0b8985ec-1e1e-46c5-a410-82a7c168d0c9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:55.006364 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0b8985ec-1e1e-46c5-a410-82a7c168d0c9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:55.014741 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b8985ec-1e1e-46c5-a410-82a7c168d0c9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:55.015969 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b8985ec-1e1e-46c5-a410-82a7c168d0c9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:55.016701 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b8985ec-1e1e-46c5-a410-82a7c168d0c9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:55.017701 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b8985ec-1e1e-46c5-a410-82a7c168d0c9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:55.018152 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b8985ec-1e1e-46c5-a410-82a7c168d0c9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:55.018572 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0b8985ec-1e1e-46c5-a410-82a7c168d0c9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:55.156715 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0b8985ec-1e1e-46c5-a410-82a7c168d0c9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:55.165237 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0b8985ec-1e1e-46c5-a410-82a7c168d0c9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.164177 Aug 30 05:19:55.165845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 476/921] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:54 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:56.186290 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-84fd5af1-68ad-4d5f-ac0e-5bf6dbc6e426 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:56.187348 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-84fd5af1-68ad-4d5f-ac0e-5bf6dbc6e426 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:56.193390 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84fd5af1-68ad-4d5f-ac0e-5bf6dbc6e426 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:56.194620 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84fd5af1-68ad-4d5f-ac0e-5bf6dbc6e426 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:56.195188 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84fd5af1-68ad-4d5f-ac0e-5bf6dbc6e426 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:56.196164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84fd5af1-68ad-4d5f-ac0e-5bf6dbc6e426 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:56.196861 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84fd5af1-68ad-4d5f-ac0e-5bf6dbc6e426 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:56.197513 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-84fd5af1-68ad-4d5f-ac0e-5bf6dbc6e426 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:56.379891 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-84fd5af1-68ad-4d5f-ac0e-5bf6dbc6e426 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:56.388183 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-84fd5af1-68ad-4d5f-ac0e-5bf6dbc6e426 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.206382 Aug 30 05:19:56.389956 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 446/922] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:56 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:57.409658 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3b8c94ae-c502-4a24-b51f-7b8d0253fa7d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:57.410274 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3b8c94ae-c502-4a24-b51f-7b8d0253fa7d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:57.417082 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b8c94ae-c502-4a24-b51f-7b8d0253fa7d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:57.417569 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b8c94ae-c502-4a24-b51f-7b8d0253fa7d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:57.418196 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b8c94ae-c502-4a24-b51f-7b8d0253fa7d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:57.419074 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b8c94ae-c502-4a24-b51f-7b8d0253fa7d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:57.419550 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b8c94ae-c502-4a24-b51f-7b8d0253fa7d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:57.419948 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3b8c94ae-c502-4a24-b51f-7b8d0253fa7d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:57.623777 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3b8c94ae-c502-4a24-b51f-7b8d0253fa7d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:57.632922 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3b8c94ae-c502-4a24-b51f-7b8d0253fa7d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.227448 Aug 30 05:19:57.634471 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 477/923] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:57 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:58.657199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ce4fada8-3f69-4332-b0a7-678e86f6200c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:58.658709 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ce4fada8-3f69-4332-b0a7-678e86f6200c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:58.668770 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce4fada8-3f69-4332-b0a7-678e86f6200c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:58.669268 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce4fada8-3f69-4332-b0a7-678e86f6200c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:58.669928 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce4fada8-3f69-4332-b0a7-678e86f6200c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:58.671713 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce4fada8-3f69-4332-b0a7-678e86f6200c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:58.672363 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce4fada8-3f69-4332-b0a7-678e86f6200c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:58.672795 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ce4fada8-3f69-4332-b0a7-678e86f6200c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:58.902485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ce4fada8-3f69-4332-b0a7-678e86f6200c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:58.911348 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ce4fada8-3f69-4332-b0a7-678e86f6200c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.258863 Aug 30 05:19:58.925145 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 447/924] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:58 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:59.933844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e11c6729-2429-4bac-9d73-669597ae4526 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:59.940405 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e11c6729-2429-4bac-9d73-669597ae4526 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:59.946618 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e11c6729-2429-4bac-9d73-669597ae4526 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:59.947132 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e11c6729-2429-4bac-9d73-669597ae4526 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:59.947566 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e11c6729-2429-4bac-9d73-669597ae4526 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:59.948265 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e11c6729-2429-4bac-9d73-669597ae4526 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:59.948770 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e11c6729-2429-4bac-9d73-669597ae4526 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:59.949118 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e11c6729-2429-4bac-9d73-669597ae4526 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:00.134082 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e11c6729-2429-4bac-9d73-669597ae4526 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:00.142174 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e11c6729-2429-4bac-9d73-669597ae4526 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.213381 Aug 30 05:20:00.152950 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 478/925] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:59 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:01.164095 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ca495a78-f83d-4720-9cb1-6a37d7d86a43 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:01.164742 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ca495a78-f83d-4720-9cb1-6a37d7d86a43 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:01.171800 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca495a78-f83d-4720-9cb1-6a37d7d86a43 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:01.172291 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca495a78-f83d-4720-9cb1-6a37d7d86a43 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:01.172729 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca495a78-f83d-4720-9cb1-6a37d7d86a43 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:01.173422 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca495a78-f83d-4720-9cb1-6a37d7d86a43 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:01.173880 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca495a78-f83d-4720-9cb1-6a37d7d86a43 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:01.174315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ca495a78-f83d-4720-9cb1-6a37d7d86a43 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:01.301127 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ca495a78-f83d-4720-9cb1-6a37d7d86a43 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:01.308527 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ca495a78-f83d-4720-9cb1-6a37d7d86a43 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.148337 Aug 30 05:20:01.309092 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 448/926] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:01 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:20:02.329031 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-80eec903-f6b8-437b-b579-6316231ae71a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:02.329649 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-80eec903-f6b8-437b-b579-6316231ae71a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:02.331576 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:02.332232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:02.337881 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80eec903-f6b8-437b-b579-6316231ae71a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:02.338368 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80eec903-f6b8-437b-b579-6316231ae71a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:02.338806 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80eec903-f6b8-437b-b579-6316231ae71a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:02.339522 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80eec903-f6b8-437b-b579-6316231ae71a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:02.340250 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80eec903-f6b8-437b-b579-6316231ae71a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:02.340655 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-80eec903-f6b8-437b-b579-6316231ae71a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:02.465493 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-80eec903-f6b8-437b-b579-6316231ae71a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:02.473166 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-80eec903-f6b8-437b-b579-6316231ae71a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.148007 Aug 30 05:20:02.473658 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 479/927] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:02 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:03.493488 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9bb6594b-81da-429e-9038-1a9b94b4f6a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:03.494224 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9bb6594b-81da-429e-9038-1a9b94b4f6a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:03.496208 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=6 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:03.502741 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9bb6594b-81da-429e-9038-1a9b94b4f6a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:03.503266 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9bb6594b-81da-429e-9038-1a9b94b4f6a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:03.503700 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9bb6594b-81da-429e-9038-1a9b94b4f6a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:03.504416 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9bb6594b-81da-429e-9038-1a9b94b4f6a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:03.504872 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9bb6594b-81da-429e-9038-1a9b94b4f6a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:03.505309 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9bb6594b-81da-429e-9038-1a9b94b4f6a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:03.634753 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9bb6594b-81da-429e-9038-1a9b94b4f6a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:03.643703 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9bb6594b-81da-429e-9038-1a9b94b4f6a9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.153948 Aug 30 05:20:03.644498 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 449/928] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:03 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:04.039164 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-a3755ba8-a174-4767-a2d0-da65f7110613 req-0a083f9c-faf1-4525-a11e-7611626fe211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "565b3109-ab27-4465-aa1c-b4002d4e9792", "tag": "71a60ab2-f1e6-480a-89ba-78b963887538"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:04.049190 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-a3755ba8-a174-4767-a2d0-da65f7110613 req-0a083f9c-faf1-4525-a11e-7611626fe211 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:04.049647 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-a3755ba8-a174-4767-a2d0-da65f7110613 req-0a083f9c-faf1-4525-a11e-7611626fe211 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:04.050132 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-a3755ba8-a174-4767-a2d0-da65f7110613 req-0a083f9c-faf1-4525-a11e-7611626fe211 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:04.061084 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-a3755ba8-a174-4767-a2d0-da65f7110613 req-0a083f9c-faf1-4525-a11e-7611626fe211 service nova] Creating event network-changed:71a60ab2-f1e6-480a-89ba-78b963887538 for instance 565b3109-ab27-4465-aa1c-b4002d4e9792 on hv-cinder-85391 Aug 30 05:20:04.066462 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-a3755ba8-a174-4767-a2d0-da65f7110613 req-0a083f9c-faf1-4525-a11e-7611626fe211 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031094 Aug 30 05:20:04.067077 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 480/929] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:04.664766 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f199304a-a6f4-4ffa-9230-93d5f9dc4bfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:04.665295 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f199304a-a6f4-4ffa-9230-93d5f9dc4bfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:04.671646 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f199304a-a6f4-4ffa-9230-93d5f9dc4bfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:04.672128 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f199304a-a6f4-4ffa-9230-93d5f9dc4bfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:04.672560 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f199304a-a6f4-4ffa-9230-93d5f9dc4bfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:04.673239 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f199304a-a6f4-4ffa-9230-93d5f9dc4bfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:04.673694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f199304a-a6f4-4ffa-9230-93d5f9dc4bfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:04.674113 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f199304a-a6f4-4ffa-9230-93d5f9dc4bfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:04.800740 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f199304a-a6f4-4ffa-9230-93d5f9dc4bfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:04.809356 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f199304a-a6f4-4ffa-9230-93d5f9dc4bfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.148498 Aug 30 05:20:04.809926 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 450/930] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:04 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:05.832524 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-504db5ff-688e-439f-bd42-28b99fef6042 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:05.833234 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-504db5ff-688e-439f-bd42-28b99fef6042 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:05.839328 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-504db5ff-688e-439f-bd42-28b99fef6042 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:05.840064 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-504db5ff-688e-439f-bd42-28b99fef6042 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:05.840504 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-504db5ff-688e-439f-bd42-28b99fef6042 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:05.841193 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-504db5ff-688e-439f-bd42-28b99fef6042 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:05.841651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-504db5ff-688e-439f-bd42-28b99fef6042 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:05.842074 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-504db5ff-688e-439f-bd42-28b99fef6042 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:05.968413 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-504db5ff-688e-439f-bd42-28b99fef6042 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:05.975965 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-504db5ff-688e-439f-bd42-28b99fef6042 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.148782 Aug 30 05:20:05.976670 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 481/931] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:05 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:06.997177 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f9597fbf-b8e9-4b0a-b2a4-c69000c436b2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:06.997720 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f9597fbf-b8e9-4b0a-b2a4-c69000c436b2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:07.003994 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9597fbf-b8e9-4b0a-b2a4-c69000c436b2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:07.004506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9597fbf-b8e9-4b0a-b2a4-c69000c436b2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:07.004939 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9597fbf-b8e9-4b0a-b2a4-c69000c436b2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:07.005618 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9597fbf-b8e9-4b0a-b2a4-c69000c436b2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:07.006072 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9597fbf-b8e9-4b0a-b2a4-c69000c436b2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:07.006494 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9597fbf-b8e9-4b0a-b2a4-c69000c436b2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:07.135545 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f9597fbf-b8e9-4b0a-b2a4-c69000c436b2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:07.143747 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f9597fbf-b8e9-4b0a-b2a4-c69000c436b2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.150481 Aug 30 05:20:07.144326 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 451/932] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:06 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:08.164616 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d6eddbf4-caee-4be4-b002-1ce78ed9b43e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:08.165147 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d6eddbf4-caee-4be4-b002-1ce78ed9b43e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:08.171653 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6eddbf4-caee-4be4-b002-1ce78ed9b43e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:08.172136 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6eddbf4-caee-4be4-b002-1ce78ed9b43e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:08.172581 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6eddbf4-caee-4be4-b002-1ce78ed9b43e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:08.173271 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6eddbf4-caee-4be4-b002-1ce78ed9b43e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:08.174325 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6eddbf4-caee-4be4-b002-1ce78ed9b43e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:08.174752 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d6eddbf4-caee-4be4-b002-1ce78ed9b43e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:08.299903 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d6eddbf4-caee-4be4-b002-1ce78ed9b43e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:08.307542 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d6eddbf4-caee-4be4-b002-1ce78ed9b43e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.146811 Aug 30 05:20:08.308115 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 482/933] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:08 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:09.328002 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a05fb225-7b1c-4702-9458-e0d6221c0894 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:09.328611 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a05fb225-7b1c-4702-9458-e0d6221c0894 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:09.334965 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a05fb225-7b1c-4702-9458-e0d6221c0894 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:09.335449 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a05fb225-7b1c-4702-9458-e0d6221c0894 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:09.335876 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a05fb225-7b1c-4702-9458-e0d6221c0894 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:09.336558 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a05fb225-7b1c-4702-9458-e0d6221c0894 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:09.337006 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a05fb225-7b1c-4702-9458-e0d6221c0894 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:09.337428 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a05fb225-7b1c-4702-9458-e0d6221c0894 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:09.466134 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-a05fb225-7b1c-4702-9458-e0d6221c0894 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:09.475064 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a05fb225-7b1c-4702-9458-e0d6221c0894 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.150687 Aug 30 05:20:09.475648 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 452/934] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:09 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:10.496143 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-40902642-2c9a-4a6d-9d64-422d65e09d95 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:10.496757 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-40902642-2c9a-4a6d-9d64-422d65e09d95 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:10.504060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40902642-2c9a-4a6d-9d64-422d65e09d95 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:10.504542 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40902642-2c9a-4a6d-9d64-422d65e09d95 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:10.504974 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40902642-2c9a-4a6d-9d64-422d65e09d95 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:10.505659 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40902642-2c9a-4a6d-9d64-422d65e09d95 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:10.506109 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40902642-2c9a-4a6d-9d64-422d65e09d95 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:10.506564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40902642-2c9a-4a6d-9d64-422d65e09d95 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:10.631605 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-40902642-2c9a-4a6d-9d64-422d65e09d95 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:10.639370 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-40902642-2c9a-4a6d-9d64-422d65e09d95 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.147045 Aug 30 05:20:10.639970 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 483/935] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:10 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:11.659675 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3fd64b45-958c-4211-929f-6dbd650dc587 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:11.660291 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3fd64b45-958c-4211-929f-6dbd650dc587 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:11.666660 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fd64b45-958c-4211-929f-6dbd650dc587 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:11.667177 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fd64b45-958c-4211-929f-6dbd650dc587 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:11.667608 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fd64b45-958c-4211-929f-6dbd650dc587 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:11.668290 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fd64b45-958c-4211-929f-6dbd650dc587 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:11.668742 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fd64b45-958c-4211-929f-6dbd650dc587 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:11.669166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3fd64b45-958c-4211-929f-6dbd650dc587 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:11.811750 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3fd64b45-958c-4211-929f-6dbd650dc587 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:11.819694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3fd64b45-958c-4211-929f-6dbd650dc587 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.163870 Aug 30 05:20:11.820249 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 453/936] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:11 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:12.228398 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1308271930", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1477137281", "security_groups": [{"name": "tempest-secgroup-smoke-21014458"}], "block_device_mapping_v2": [{"uuid": "ae8b23fb-7607-4a6f-ae00-32899b6a10c6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "15c65eeb-dfe2-43bb-9925-99f6c334ef61"}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:12.349366 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] validate_networks() for [('15c65eeb-dfe2-43bb-9925-99f6c334ef61', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:20:12.734010 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:20:12.734436 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:20:12.734964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:20:12.735379 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:20:12.735885 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:20:12.744783 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:12.745263 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:12.745694 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:12.746416 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:12.746888 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:12.747311 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:12.767760 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Getting quotas for project 97e3452b02294219ae56cd23eb2aa0ce. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:20:12.771850 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Getting quotas for user 9256fd43e5124fb68d4e5453584d1e8d and project 97e3452b02294219ae56cd23eb2aa0ce. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:20:12.834600 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:20:12.837074 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae8b23fb-7607-4a6f-ae00-32899b6a10c6',volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:20:12.839392 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1cf1c465-2f96-4fb1-b1b1-2a85d5a389be tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:12.840915 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1cf1c465-2f96-4fb1-b1b1-2a85d5a389be tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:12.849283 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cf1c465-2f96-4fb1-b1b1-2a85d5a389be tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:12.849911 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cf1c465-2f96-4fb1-b1b1-2a85d5a389be tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:12.850418 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cf1c465-2f96-4fb1-b1b1-2a85d5a389be tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:12.851215 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cf1c465-2f96-4fb1-b1b1-2a85d5a389be tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:12.851866 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cf1c465-2f96-4fb1-b1b1-2a85d5a389be tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:12.852663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1cf1c465-2f96-4fb1-b1b1-2a85d5a389be tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:13.075647 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c7c5b639-4a74-46f8-b580-f78833d17ec9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.851206 Aug 30 05:20:13.076920 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 484/937] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:20:12 2022] POST /compute/v2.1/servers => generated 404 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:20:13.094411 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d20f94d1-2237-45c6-8953-303ac4cc57c5 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:13.099828 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d20f94d1-2237-45c6-8953-303ac4cc57c5 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:13.105749 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1cf1c465-2f96-4fb1-b1b1-2a85d5a389be tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:13.115717 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1cf1c465-2f96-4fb1-b1b1-2a85d5a389be tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.279740 Aug 30 05:20:13.131987 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 454/938] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:12 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:13.170407 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d20f94d1-2237-45c6-8953-303ac4cc57c5 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:13.177232 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d20f94d1-2237-45c6-8953-303ac4cc57c5 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1095 microversion: 2.1 time: 0.093276 Aug 30 05:20:13.177842 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 485/939] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:13 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1095 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:20:13.560648 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-28572b3f-5e6d-477e-9a8b-a97c418ff12e req-3748a95a-bda5-4792-af6e-9232e8ab6f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565b3109-ab27-4465-aa1c-b4002d4e9792", "name": "network-vif-plugged", "status": "completed", "tag": "71a60ab2-f1e6-480a-89ba-78b963887538"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:13.572696 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-28572b3f-5e6d-477e-9a8b-a97c418ff12e req-3748a95a-bda5-4792-af6e-9232e8ab6f80 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:13.573223 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-28572b3f-5e6d-477e-9a8b-a97c418ff12e req-3748a95a-bda5-4792-af6e-9232e8ab6f80 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:13.573723 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-28572b3f-5e6d-477e-9a8b-a97c418ff12e req-3748a95a-bda5-4792-af6e-9232e8ab6f80 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:13.585338 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-28572b3f-5e6d-477e-9a8b-a97c418ff12e req-3748a95a-bda5-4792-af6e-9232e8ab6f80 service nova] Creating event network-vif-plugged:71a60ab2-f1e6-480a-89ba-78b963887538 for instance 565b3109-ab27-4465-aa1c-b4002d4e9792 on hv-cinder-85391 Aug 30 05:20:13.590933 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-28572b3f-5e6d-477e-9a8b-a97c418ff12e req-3748a95a-bda5-4792-af6e-9232e8ab6f80 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034029 Aug 30 05:20:13.592122 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 455/940] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:14.136107 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2fa97e1c-5d10-4d28-9dff-1d9a3fe4144c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:14.136725 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2fa97e1c-5d10-4d28-9dff-1d9a3fe4144c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:14.143090 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fa97e1c-5d10-4d28-9dff-1d9a3fe4144c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:14.143580 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fa97e1c-5d10-4d28-9dff-1d9a3fe4144c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:14.144021 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fa97e1c-5d10-4d28-9dff-1d9a3fe4144c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:14.144714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fa97e1c-5d10-4d28-9dff-1d9a3fe4144c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:14.145170 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fa97e1c-5d10-4d28-9dff-1d9a3fe4144c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:14.145599 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2fa97e1c-5d10-4d28-9dff-1d9a3fe4144c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:14.197985 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dd89bcd1-98b3-4ee6-9098-0b656f9d456f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:14.198692 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dd89bcd1-98b3-4ee6-9098-0b656f9d456f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:14.205910 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd89bcd1-98b3-4ee6-9098-0b656f9d456f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:14.206402 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd89bcd1-98b3-4ee6-9098-0b656f9d456f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:14.206870 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd89bcd1-98b3-4ee6-9098-0b656f9d456f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:14.207575 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd89bcd1-98b3-4ee6-9098-0b656f9d456f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:14.208038 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd89bcd1-98b3-4ee6-9098-0b656f9d456f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:14.208477 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dd89bcd1-98b3-4ee6-9098-0b656f9d456f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:14.270092 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dd89bcd1-98b3-4ee6-9098-0b656f9d456f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:14.277715 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dd89bcd1-98b3-4ee6-9098-0b656f9d456f tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1193 microversion: 2.1 time: 0.083929 Aug 30 05:20:14.278299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 456/941] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:14 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:20:14.279871 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2fa97e1c-5d10-4d28-9dff-1d9a3fe4144c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:14.288088 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2fa97e1c-5d10-4d28-9dff-1d9a3fe4144c tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.155749 Aug 30 05:20:14.288641 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 486/942] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:14 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:15.299080 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-421910e2-3ac5-415b-8c5b-c6f0b6f13b5d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:15.299694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-421910e2-3ac5-415b-8c5b-c6f0b6f13b5d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:15.305992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-421910e2-3ac5-415b-8c5b-c6f0b6f13b5d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:15.306475 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-421910e2-3ac5-415b-8c5b-c6f0b6f13b5d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:15.306949 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-421910e2-3ac5-415b-8c5b-c6f0b6f13b5d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:15.307641 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-421910e2-3ac5-415b-8c5b-c6f0b6f13b5d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:15.308094 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-421910e2-3ac5-415b-8c5b-c6f0b6f13b5d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:15.308253 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d9e93f0c-1f65-4666-b3bd-7f64e8782237 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:15.308671 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-421910e2-3ac5-415b-8c5b-c6f0b6f13b5d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:15.308867 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d9e93f0c-1f65-4666-b3bd-7f64e8782237 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:15.315185 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9e93f0c-1f65-4666-b3bd-7f64e8782237 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:15.315668 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9e93f0c-1f65-4666-b3bd-7f64e8782237 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:15.316109 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9e93f0c-1f65-4666-b3bd-7f64e8782237 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:15.316799 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9e93f0c-1f65-4666-b3bd-7f64e8782237 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:15.317252 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9e93f0c-1f65-4666-b3bd-7f64e8782237 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:15.317677 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d9e93f0c-1f65-4666-b3bd-7f64e8782237 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:15.374198 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-421910e2-3ac5-415b-8c5b-c6f0b6f13b5d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:15.382068 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-421910e2-3ac5-415b-8c5b-c6f0b6f13b5d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1211 microversion: 2.1 time: 0.087629 Aug 30 05:20:15.382646 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 457/943] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:15 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:20:15.448401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d9e93f0c-1f65-4666-b3bd-7f64e8782237 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:15.456000 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d9e93f0c-1f65-4666-b3bd-7f64e8782237 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.151596 Aug 30 05:20:15.456566 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 487/944] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:15 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:20:16.402724 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6cbb239a-0727-4480-abbf-3d19caeae10d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:16.403369 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6cbb239a-0727-4480-abbf-3d19caeae10d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:16.409733 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cbb239a-0727-4480-abbf-3d19caeae10d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:16.410219 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cbb239a-0727-4480-abbf-3d19caeae10d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:16.410656 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cbb239a-0727-4480-abbf-3d19caeae10d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:16.411375 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cbb239a-0727-4480-abbf-3d19caeae10d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:16.411832 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cbb239a-0727-4480-abbf-3d19caeae10d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:16.412256 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6cbb239a-0727-4480-abbf-3d19caeae10d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:16.473154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6cbb239a-0727-4480-abbf-3d19caeae10d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:16.476233 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-26e72a79-2811-4316-84ca-a652221e6916 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:16.476881 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-26e72a79-2811-4316-84ca-a652221e6916 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:16.480955 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6cbb239a-0727-4480-abbf-3d19caeae10d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1211 microversion: 2.1 time: 0.082101 Aug 30 05:20:16.481521 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 458/945] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:16 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1211 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:16.483368 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26e72a79-2811-4316-84ca-a652221e6916 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:16.483852 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26e72a79-2811-4316-84ca-a652221e6916 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:16.484288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26e72a79-2811-4316-84ca-a652221e6916 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:16.484982 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26e72a79-2811-4316-84ca-a652221e6916 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:16.485433 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26e72a79-2811-4316-84ca-a652221e6916 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:16.486364 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-26e72a79-2811-4316-84ca-a652221e6916 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:16.609993 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-26e72a79-2811-4316-84ca-a652221e6916 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:16.618198 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-26e72a79-2811-4316-84ca-a652221e6916 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.145749 Aug 30 05:20:16.619108 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 488/946] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:16 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:20:17.501937 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-618b3b4e-2e37-4bea-b052-2e772f904936 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:17.502594 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-618b3b4e-2e37-4bea-b052-2e772f904936 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:17.508971 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-618b3b4e-2e37-4bea-b052-2e772f904936 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:17.509450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-618b3b4e-2e37-4bea-b052-2e772f904936 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:17.509879 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-618b3b4e-2e37-4bea-b052-2e772f904936 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:17.510560 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-618b3b4e-2e37-4bea-b052-2e772f904936 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:17.511049 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-618b3b4e-2e37-4bea-b052-2e772f904936 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:17.511473 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-618b3b4e-2e37-4bea-b052-2e772f904936 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:17.571295 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-618b3b4e-2e37-4bea-b052-2e772f904936 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:17.578761 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-618b3b4e-2e37-4bea-b052-2e772f904936 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1211 microversion: 2.1 time: 0.080667 Aug 30 05:20:17.579396 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 459/947] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:17 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:17.639027 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-211d159e-df36-4365-a280-f98dd1724643 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:17.639648 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-211d159e-df36-4365-a280-f98dd1724643 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:17.647037 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-211d159e-df36-4365-a280-f98dd1724643 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:17.647537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-211d159e-df36-4365-a280-f98dd1724643 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:17.647975 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-211d159e-df36-4365-a280-f98dd1724643 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:17.648725 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-211d159e-df36-4365-a280-f98dd1724643 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:17.649218 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-211d159e-df36-4365-a280-f98dd1724643 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:17.649701 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-211d159e-df36-4365-a280-f98dd1724643 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:17.781158 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-211d159e-df36-4365-a280-f98dd1724643 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:17.789134 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-211d159e-df36-4365-a280-f98dd1724643 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1358 microversion: 2.1 time: 0.154079 Aug 30 05:20:17.789704 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 489/948] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:17 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:18.600588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-14934a29-5112-4c7c-973e-fff604c1298d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:18.601209 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-14934a29-5112-4c7c-973e-fff604c1298d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:18.608290 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14934a29-5112-4c7c-973e-fff604c1298d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:18.609062 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14934a29-5112-4c7c-973e-fff604c1298d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:18.609529 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14934a29-5112-4c7c-973e-fff604c1298d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:18.611242 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14934a29-5112-4c7c-973e-fff604c1298d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:18.611713 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14934a29-5112-4c7c-973e-fff604c1298d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:18.612149 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-14934a29-5112-4c7c-973e-fff604c1298d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:18.675815 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-14934a29-5112-4c7c-973e-fff604c1298d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:18.685814 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-14934a29-5112-4c7c-973e-fff604c1298d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1211 microversion: 2.1 time: 0.089108 Aug 30 05:20:18.686692 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 460/949] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:18 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:18.813198 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-99aa7bdc-73a5-48c2-b990-d339ba435a41 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:18.814378 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-99aa7bdc-73a5-48c2-b990-d339ba435a41 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:18.822136 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99aa7bdc-73a5-48c2-b990-d339ba435a41 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:18.822846 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99aa7bdc-73a5-48c2-b990-d339ba435a41 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:18.823461 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99aa7bdc-73a5-48c2-b990-d339ba435a41 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:18.824338 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99aa7bdc-73a5-48c2-b990-d339ba435a41 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:18.824951 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99aa7bdc-73a5-48c2-b990-d339ba435a41 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:18.825532 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-99aa7bdc-73a5-48c2-b990-d339ba435a41 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:19.087190 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-99aa7bdc-73a5-48c2-b990-d339ba435a41 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:19.098722 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-99aa7bdc-73a5-48c2-b990-d339ba435a41 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1549 microversion: 2.1 time: 0.292755 Aug 30 05:20:19.099848 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 490/950] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:18 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1549 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:19.123782 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ef71251d-c387-41e6-9ecc-d5c7c04cb0bb tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:19.124405 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ef71251d-c387-41e6-9ecc-d5c7c04cb0bb tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:19.131883 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef71251d-c387-41e6-9ecc-d5c7c04cb0bb tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:19.132327 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef71251d-c387-41e6-9ecc-d5c7c04cb0bb tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:19.132994 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef71251d-c387-41e6-9ecc-d5c7c04cb0bb tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:19.134286 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef71251d-c387-41e6-9ecc-d5c7c04cb0bb tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:19.134740 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef71251d-c387-41e6-9ecc-d5c7c04cb0bb tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:19.135188 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ef71251d-c387-41e6-9ecc-d5c7c04cb0bb tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:19.279223 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ef71251d-c387-41e6-9ecc-d5c7c04cb0bb tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:19.287206 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ef71251d-c387-41e6-9ecc-d5c7c04cb0bb tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1549 microversion: 2.1 time: 0.167576 Aug 30 05:20:19.298842 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 461/951] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:19 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:19.307993 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-86c9ed6b-9963-4b10-9523-e9337b662fce tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:19.312821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-86c9ed6b-9963-4b10-9523-e9337b662fce tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:19.314086 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-86c9ed6b-9963-4b10-9523-e9337b662fce tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Searching by: {'deleted': False, 'project_id': '4826d4507ffc4e3288aac00b1409ea46'} {{(pid=120572) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 05:20:19.320561 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86c9ed6b-9963-4b10-9523-e9337b662fce tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:19.321037 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86c9ed6b-9963-4b10-9523-e9337b662fce tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:19.321727 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86c9ed6b-9963-4b10-9523-e9337b662fce tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:19.322449 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86c9ed6b-9963-4b10-9523-e9337b662fce tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:19.322931 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86c9ed6b-9963-4b10-9523-e9337b662fce tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:19.323356 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-86c9ed6b-9963-4b10-9523-e9337b662fce tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:19.580249 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.multi_cell_list [None req-86c9ed6b-9963-4b10-9523-e9337b662fce tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120572) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 05:20:19.674953 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-86c9ed6b-9963-4b10-9523-e9337b662fce tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.370578 Aug 30 05:20:19.675546 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 491/952] 10.222.0.77 () {58 vars in 1125 bytes} [Tue Aug 30 05:20:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:19.686589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-96b9ce2f-765c-4d4a-9453-8c44079c946e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:19.687223 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-96b9ce2f-765c-4d4a-9453-8c44079c946e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:19.694176 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96b9ce2f-765c-4d4a-9453-8c44079c946e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:19.694660 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96b9ce2f-765c-4d4a-9453-8c44079c946e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:19.695124 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96b9ce2f-765c-4d4a-9453-8c44079c946e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:19.695816 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96b9ce2f-765c-4d4a-9453-8c44079c946e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:19.696270 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96b9ce2f-765c-4d4a-9453-8c44079c946e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:19.696693 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-96b9ce2f-765c-4d4a-9453-8c44079c946e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:19.700884 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=100 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:19.709627 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e2fc978b-7c46-441c-9209-217976fc81bd tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:19.710262 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e2fc978b-7c46-441c-9209-217976fc81bd tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:19.716565 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2fc978b-7c46-441c-9209-217976fc81bd tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:19.717054 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2fc978b-7c46-441c-9209-217976fc81bd tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:19.717492 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2fc978b-7c46-441c-9209-217976fc81bd tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:19.718190 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2fc978b-7c46-441c-9209-217976fc81bd tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:19.718646 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2fc978b-7c46-441c-9209-217976fc81bd tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:19.719160 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e2fc978b-7c46-441c-9209-217976fc81bd tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:19.840385 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-96b9ce2f-765c-4d4a-9453-8c44079c946e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:19.848963 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-96b9ce2f-765c-4d4a-9453-8c44079c946e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1549 microversion: 2.1 time: 0.166159 Aug 30 05:20:19.849667 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 462/953] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:19 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:20:19.854464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-d7c76e60-2e38-41a6-83f3-d56f8e3e73f9 req-544e25ec-7b32-4860-8d1d-c442122afd02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d44a2416-35ea-4b7d-b8b6-a68d9d578ca5", "tag": "7450aa1e-23d7-43dd-a88d-807ca70eed93"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:19.864394 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d7c76e60-2e38-41a6-83f3-d56f8e3e73f9 req-544e25ec-7b32-4860-8d1d-c442122afd02 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:19.864992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d7c76e60-2e38-41a6-83f3-d56f8e3e73f9 req-544e25ec-7b32-4860-8d1d-c442122afd02 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:19.865525 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-d7c76e60-2e38-41a6-83f3-d56f8e3e73f9 req-544e25ec-7b32-4860-8d1d-c442122afd02 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:19.880051 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-d7c76e60-2e38-41a6-83f3-d56f8e3e73f9 req-544e25ec-7b32-4860-8d1d-c442122afd02 service nova] Creating event network-changed:7450aa1e-23d7-43dd-a88d-807ca70eed93 for instance d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 on hv-cinder-85391 Aug 30 05:20:19.885375 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-d7c76e60-2e38-41a6-83f3-d56f8e3e73f9 req-544e25ec-7b32-4860-8d1d-c442122afd02 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034441 Aug 30 05:20:19.886292 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 463/954] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:19.965411 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e2fc978b-7c46-441c-9209-217976fc81bd tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:19.974448 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e2fc978b-7c46-441c-9209-217976fc81bd tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1265 microversion: 2.1 time: 0.269997 Aug 30 05:20:19.975302 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 492/955] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:19 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:20:20.996623 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1f60a1a0-21e1-4874-b3c5-e749237ea092 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:20.997275 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1f60a1a0-21e1-4874-b3c5-e749237ea092 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:20.999627 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:21.005668 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f60a1a0-21e1-4874-b3c5-e749237ea092 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:21.006179 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f60a1a0-21e1-4874-b3c5-e749237ea092 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:21.006613 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f60a1a0-21e1-4874-b3c5-e749237ea092 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:21.007333 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f60a1a0-21e1-4874-b3c5-e749237ea092 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:21.007783 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f60a1a0-21e1-4874-b3c5-e749237ea092 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:21.008202 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1f60a1a0-21e1-4874-b3c5-e749237ea092 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:21.143606 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1f60a1a0-21e1-4874-b3c5-e749237ea092 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:21.151194 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1f60a1a0-21e1-4874-b3c5-e749237ea092 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1265 microversion: 2.1 time: 0.158970 Aug 30 05:20:21.151765 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 464/956] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:20 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:20:21.410902 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c095cb5e-aafe-4718-a221-d60614993b23 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a203d5a9-8617-4d0b-b0a1-61ac833e029d"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:21.413216 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c095cb5e-aafe-4718-a221-d60614993b23 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:21.415669 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:21.421567 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c095cb5e-aafe-4718-a221-d60614993b23 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:21.422141 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c095cb5e-aafe-4718-a221-d60614993b23 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:21.422567 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c095cb5e-aafe-4718-a221-d60614993b23 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:21.423877 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c095cb5e-aafe-4718-a221-d60614993b23 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:21.424337 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c095cb5e-aafe-4718-a221-d60614993b23 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:21.424765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c095cb5e-aafe-4718-a221-d60614993b23 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:21.428981 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=99 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:21.675162 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c095cb5e-aafe-4718-a221-d60614993b23 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "POST /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268629 Aug 30 05:20:21.676014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 493/957] 10.222.0.77 () {60 vars in 1323 bytes} [Tue Aug 30 05:20:21 2022] POST /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:22.171483 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-64a1d8ca-cf1b-4566-86a2-ce35783a90c2 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:22.172127 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-64a1d8ca-cf1b-4566-86a2-ce35783a90c2 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:22.178636 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64a1d8ca-cf1b-4566-86a2-ce35783a90c2 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:22.179271 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64a1d8ca-cf1b-4566-86a2-ce35783a90c2 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:22.179701 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64a1d8ca-cf1b-4566-86a2-ce35783a90c2 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:22.180388 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64a1d8ca-cf1b-4566-86a2-ce35783a90c2 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:22.180839 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64a1d8ca-cf1b-4566-86a2-ce35783a90c2 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:22.181258 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-64a1d8ca-cf1b-4566-86a2-ce35783a90c2 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:22.308068 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-64a1d8ca-cf1b-4566-86a2-ce35783a90c2 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:22.316107 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-64a1d8ca-cf1b-4566-86a2-ce35783a90c2 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1265 microversion: 2.1 time: 0.148484 Aug 30 05:20:22.316674 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 465/958] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:22 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:23.338387 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b91aa882-f180-40b8-9395-4827d025ea71 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:23.339123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b91aa882-f180-40b8-9395-4827d025ea71 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:23.341922 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=8 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:23.347858 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b91aa882-f180-40b8-9395-4827d025ea71 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:23.348347 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b91aa882-f180-40b8-9395-4827d025ea71 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:23.348784 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b91aa882-f180-40b8-9395-4827d025ea71 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:23.349481 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b91aa882-f180-40b8-9395-4827d025ea71 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:23.349933 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b91aa882-f180-40b8-9395-4827d025ea71 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:23.350363 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b91aa882-f180-40b8-9395-4827d025ea71 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:23.495193 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b91aa882-f180-40b8-9395-4827d025ea71 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:23.503600 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b91aa882-f180-40b8-9395-4827d025ea71 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1265 microversion: 2.1 time: 0.169728 Aug 30 05:20:23.504390 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 494/959] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:23 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:24.525507 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4b56be40-5903-474a-a2a2-fc9e47ba2c6d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:24.526118 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4b56be40-5903-474a-a2a2-fc9e47ba2c6d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:24.532628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b56be40-5903-474a-a2a2-fc9e47ba2c6d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:24.533108 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b56be40-5903-474a-a2a2-fc9e47ba2c6d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:24.533539 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b56be40-5903-474a-a2a2-fc9e47ba2c6d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:24.534221 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b56be40-5903-474a-a2a2-fc9e47ba2c6d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:24.534675 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b56be40-5903-474a-a2a2-fc9e47ba2c6d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:24.535132 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4b56be40-5903-474a-a2a2-fc9e47ba2c6d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:24.661448 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4b56be40-5903-474a-a2a2-fc9e47ba2c6d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:24.668921 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4b56be40-5903-474a-a2a2-fc9e47ba2c6d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1265 microversion: 2.1 time: 0.147610 Aug 30 05:20:24.669488 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 466/960] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:24 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:20:25.690272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4a7cdd64-9627-4cfc-b057-e8df588aa87d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:25.691010 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4a7cdd64-9627-4cfc-b057-e8df588aa87d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:25.697518 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a7cdd64-9627-4cfc-b057-e8df588aa87d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:25.698034 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a7cdd64-9627-4cfc-b057-e8df588aa87d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:25.698472 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a7cdd64-9627-4cfc-b057-e8df588aa87d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:25.699199 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a7cdd64-9627-4cfc-b057-e8df588aa87d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:25.699656 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a7cdd64-9627-4cfc-b057-e8df588aa87d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:25.700080 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a7cdd64-9627-4cfc-b057-e8df588aa87d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:25.834132 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-4a7cdd64-9627-4cfc-b057-e8df588aa87d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:25.841997 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4a7cdd64-9627-4cfc-b057-e8df588aa87d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1265 microversion: 2.1 time: 0.156249 Aug 30 05:20:25.842573 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 495/961] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:25 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:26.862456 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4f6e1a3c-ec4f-40e2-bc37-26b96c89451c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:26.863095 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4f6e1a3c-ec4f-40e2-bc37-26b96c89451c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:26.869191 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4f6e1a3c-ec4f-40e2-bc37-26b96c89451c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:26.869675 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4f6e1a3c-ec4f-40e2-bc37-26b96c89451c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:26.870113 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4f6e1a3c-ec4f-40e2-bc37-26b96c89451c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:26.870804 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4f6e1a3c-ec4f-40e2-bc37-26b96c89451c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:26.871285 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4f6e1a3c-ec4f-40e2-bc37-26b96c89451c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:26.871712 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4f6e1a3c-ec4f-40e2-bc37-26b96c89451c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:27.002710 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4f6e1a3c-ec4f-40e2-bc37-26b96c89451c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:27.010422 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4f6e1a3c-ec4f-40e2-bc37-26b96c89451c tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1265 microversion: 2.1 time: 0.151749 Aug 30 05:20:27.011137 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 467/962] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:26 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:28.031500 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bc6cefaf-f659-4f76-b673-a5b4253c80f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:28.032098 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bc6cefaf-f659-4f76-b673-a5b4253c80f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:28.038919 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc6cefaf-f659-4f76-b673-a5b4253c80f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:28.039405 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc6cefaf-f659-4f76-b673-a5b4253c80f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:28.039854 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc6cefaf-f659-4f76-b673-a5b4253c80f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:28.040531 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc6cefaf-f659-4f76-b673-a5b4253c80f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:28.040987 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc6cefaf-f659-4f76-b673-a5b4253c80f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:28.041408 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc6cefaf-f659-4f76-b673-a5b4253c80f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:28.169594 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-bc6cefaf-f659-4f76-b673-a5b4253c80f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:28.177163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bc6cefaf-f659-4f76-b673-a5b4253c80f0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1265 microversion: 2.1 time: 0.149804 Aug 30 05:20:28.177725 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 496/963] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:28 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:29.197485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b22b1991-ee1d-465d-a70c-8d92b7557c2d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:29.198094 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b22b1991-ee1d-465d-a70c-8d92b7557c2d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:29.204969 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b22b1991-ee1d-465d-a70c-8d92b7557c2d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:29.205445 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b22b1991-ee1d-465d-a70c-8d92b7557c2d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:29.205878 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b22b1991-ee1d-465d-a70c-8d92b7557c2d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:29.206559 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b22b1991-ee1d-465d-a70c-8d92b7557c2d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:29.207061 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b22b1991-ee1d-465d-a70c-8d92b7557c2d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:29.207468 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b22b1991-ee1d-465d-a70c-8d92b7557c2d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:29.333364 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b22b1991-ee1d-465d-a70c-8d92b7557c2d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:29.341335 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b22b1991-ee1d-465d-a70c-8d92b7557c2d tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1265 microversion: 2.1 time: 0.147560 Aug 30 05:20:29.341847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 468/964] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:29 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:30.307729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b254077c-b314-4272-876f-a1b8a6e9dbcc tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:30.308343 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b254077c-b314-4272-876f-a1b8a6e9dbcc tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:30.310580 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=4 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:30.315983 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b254077c-b314-4272-876f-a1b8a6e9dbcc tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:30.316461 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b254077c-b314-4272-876f-a1b8a6e9dbcc tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:30.316895 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b254077c-b314-4272-876f-a1b8a6e9dbcc tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:30.317580 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b254077c-b314-4272-876f-a1b8a6e9dbcc tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:30.318028 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b254077c-b314-4272-876f-a1b8a6e9dbcc tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:30.318455 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b254077c-b314-4272-876f-a1b8a6e9dbcc tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:30.362179 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f9f543a6-f8f0-484b-9174-3b47c3d20888 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:30.362951 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f9f543a6-f8f0-484b-9174-3b47c3d20888 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:30.369343 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9f543a6-f8f0-484b-9174-3b47c3d20888 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:30.369903 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9f543a6-f8f0-484b-9174-3b47c3d20888 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:30.370416 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9f543a6-f8f0-484b-9174-3b47c3d20888 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:30.371209 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9f543a6-f8f0-484b-9174-3b47c3d20888 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:30.371734 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9f543a6-f8f0-484b-9174-3b47c3d20888 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:30.372232 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f9f543a6-f8f0-484b-9174-3b47c3d20888 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:30.445862 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b254077c-b314-4272-876f-a1b8a6e9dbcc tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:30.454169 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b254077c-b314-4272-876f-a1b8a6e9dbcc tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1595 microversion: 2.1 time: 0.150158 Aug 30 05:20:30.454962 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 497/965] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:30 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1595 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:20:30.504418 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f9f543a6-f8f0-484b-9174-3b47c3d20888 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:30.512124 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f9f543a6-f8f0-484b-9174-3b47c3d20888 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1265 microversion: 2.1 time: 0.154564 Aug 30 05:20:30.512697 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 469/966] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:30 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:20:31.533452 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3791f22a-670a-4b5f-addf-030662598376 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:31.533986 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3791f22a-670a-4b5f-addf-030662598376 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:31.541430 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3791f22a-670a-4b5f-addf-030662598376 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:31.541929 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3791f22a-670a-4b5f-addf-030662598376 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:31.542619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3791f22a-670a-4b5f-addf-030662598376 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:31.543994 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3791f22a-670a-4b5f-addf-030662598376 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:31.544668 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3791f22a-670a-4b5f-addf-030662598376 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:31.545104 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3791f22a-670a-4b5f-addf-030662598376 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:31.753314 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3791f22a-670a-4b5f-addf-030662598376 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:31.760967 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3791f22a-670a-4b5f-addf-030662598376 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1265 microversion: 2.1 time: 0.232731 Aug 30 05:20:31.761548 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 498/967] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:31 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:32.279234 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4cd041cc-1514-4b42-83cc-1a2a980f5f36 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:32.280469 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4cd041cc-1514-4b42-83cc-1a2a980f5f36 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:32.288301 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cd041cc-1514-4b42-83cc-1a2a980f5f36 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:32.289243 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cd041cc-1514-4b42-83cc-1a2a980f5f36 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:32.289893 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cd041cc-1514-4b42-83cc-1a2a980f5f36 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:32.291006 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cd041cc-1514-4b42-83cc-1a2a980f5f36 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:32.291711 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cd041cc-1514-4b42-83cc-1a2a980f5f36 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:32.292352 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4cd041cc-1514-4b42-83cc-1a2a980f5f36 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:32.319786 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4cd041cc-1514-4b42-83cc-1a2a980f5f36 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487/ips" status: 200 len: 150 microversion: 2.1 time: 0.045216 Aug 30 05:20:32.328662 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 470/968] 10.222.0.77 () {58 vars in 1248 bytes} [Tue Aug 30 05:20:32 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487/ips => generated 150 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:32.333659 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a421ef3d-df94-4388-8c39-6a377dc846ee tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd89bd10-7ba1-46bc-a203-52fa3deccbf4"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:32.336331 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a421ef3d-df94-4388-8c39-6a377dc846ee tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:32.347512 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a421ef3d-df94-4388-8c39-6a377dc846ee tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:32.348302 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a421ef3d-df94-4388-8c39-6a377dc846ee tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:32.348752 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a421ef3d-df94-4388-8c39-6a377dc846ee tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:32.349459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a421ef3d-df94-4388-8c39-6a377dc846ee tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:32.350081 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a421ef3d-df94-4388-8c39-6a377dc846ee tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:32.350513 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a421ef3d-df94-4388-8c39-6a377dc846ee tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:32.439359 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-a421ef3d-df94-4388-8c39-6a377dc846ee tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] HTTP exception thrown: Invalid volume: volume dd89bd10-7ba1-46bc-a203-52fa3deccbf4 is already attached to instances: cd7486a8-b5d7-45e0-921a-6621d9a10233 Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a421ef3d-df94-4388-8c39-6a377dc846ee tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Request method failure captured: Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: POST /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487/os-volume_attachments HTTP/1.1 Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 74 Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZ1_BwqBAvo25XUAt_hPX0zVighjm0QlniWU-jqAI4fG3e31IXufsUyXytncyQcNIsqbFJosPnnVGxtyzcvHCLdS0OGpuhx6w1qakeVZUvmKyNmZ6a2aA0JwLTrTvk1kHTprNY5RT9dfrhFGUO0IJBcYTYeHf_BQhuD-oVr-rD2jMpc Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:20:32.441123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:20:32.442564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bebd859c24cd4ed3b7e32a82de820b8a", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:20:32.442564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:20:32.442564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:20:32.442564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:20:32.442564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:20:32.442564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:20:32.442564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:20:32.442564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: d079e0264f0e40db9fc93b8f217a7a74 Aug 30 05:20:32.442564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:20:32.442564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Aug 30 05:20:32.442564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {"volumeAttachment": {"volumeId": "dd89bd10-7ba1-46bc-a203-52fa3deccbf4"}} Aug 30 05:20:32.442564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Invalid volume: volume dd89bd10-7ba1-46bc-a203-52fa3deccbf4 is already attached to instances: cd7486a8-b5d7-45e0-921a-6621d9a10233 Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'server_id': '4766e8f6-4e42-4773-bb22-b725770d2487', 'body': {'volumeAttachment': {'volumeId': 'dd89bd10-7ba1-46bc-a203-52fa3deccbf4'}}} Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dd89bd10-7ba1-46bc-a203-52fa3deccbf4 is already attached to instances: cd7486a8-b5d7-45e0-921a-6621d9a10233 Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:20:32.443592 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dd89bd10-7ba1-46bc-a203-52fa3deccbf4 is already attached to instances: cd7486a8-b5d7-45e0-921a-6621d9a10233 Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:20:32.445008 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:20:32.447369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:20:32.447369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:20:32.447369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:20:32.447369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dd89bd10-7ba1-46bc-a203-52fa3deccbf4 is already attached to instances: cd7486a8-b5d7-45e0-921a-6621d9a10233 Aug 30 05:20:32.447369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:20:32.447369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a421ef3d-df94-4388-8c39-6a377dc846ee tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Returning 400 to user: Invalid volume: volume dd89bd10-7ba1-46bc-a203-52fa3deccbf4 is already attached to instances: cd7486a8-b5d7-45e0-921a-6621d9a10233 {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:20:32.447369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a421ef3d-df94-4388-8c39-6a377dc846ee tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "POST /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113769 Aug 30 05:20:32.447369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 499/969] 10.222.0.77 () {60 vars in 1323 bytes} [Tue Aug 30 05:20:32 2022] POST /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 05:20:32.451369 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c11603cb-3702-4d46-a177-8899697d22ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:32.451875 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c11603cb-3702-4d46-a177-8899697d22ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:32.468848 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c11603cb-3702-4d46-a177-8899697d22ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:32.469708 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c11603cb-3702-4d46-a177-8899697d22ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:32.470143 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c11603cb-3702-4d46-a177-8899697d22ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:32.471064 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c11603cb-3702-4d46-a177-8899697d22ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:32.471530 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c11603cb-3702-4d46-a177-8899697d22ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:32.471956 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c11603cb-3702-4d46-a177-8899697d22ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:32.501817 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c11603cb-3702-4d46-a177-8899697d22ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:20:32.521126 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-96d2c837-4f39-401d-bc0a-87c71f91d6cc req-731ba251-8bc9-4870-916e-5269bae91026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "565b3109-ab27-4465-aa1c-b4002d4e9792", "tag": "71a60ab2-f1e6-480a-89ba-78b963887538"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:32.537221 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-96d2c837-4f39-401d-bc0a-87c71f91d6cc req-731ba251-8bc9-4870-916e-5269bae91026 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:32.537767 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-96d2c837-4f39-401d-bc0a-87c71f91d6cc req-731ba251-8bc9-4870-916e-5269bae91026 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:32.538031 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-96d2c837-4f39-401d-bc0a-87c71f91d6cc req-731ba251-8bc9-4870-916e-5269bae91026 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:32.551994 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-96d2c837-4f39-401d-bc0a-87c71f91d6cc req-731ba251-8bc9-4870-916e-5269bae91026 service nova] Creating event network-changed:71a60ab2-f1e6-480a-89ba-78b963887538 for instance 565b3109-ab27-4465-aa1c-b4002d4e9792 on hv-cinder-85391 Aug 30 05:20:32.558196 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-96d2c837-4f39-401d-bc0a-87c71f91d6cc req-731ba251-8bc9-4870-916e-5269bae91026 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040585 Aug 30 05:20:32.559182 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 500/970] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:32.627543 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c11603cb-3702-4d46-a177-8899697d22ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "DELETE /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 204 len: 0 microversion: 2.1 time: 0.178315 Aug 30 05:20:32.628612 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 471/971] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:20:32 2022] DELETE /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:20:32.637599 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5984792d-50e6-4338-a1a3-3f6722cec043 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:32.638362 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5984792d-50e6-4338-a1a3-3f6722cec043 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:32.648115 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5984792d-50e6-4338-a1a3-3f6722cec043 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:32.648891 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5984792d-50e6-4338-a1a3-3f6722cec043 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:32.649476 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5984792d-50e6-4338-a1a3-3f6722cec043 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:32.650239 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5984792d-50e6-4338-a1a3-3f6722cec043 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:32.650862 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5984792d-50e6-4338-a1a3-3f6722cec043 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:32.651534 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5984792d-50e6-4338-a1a3-3f6722cec043 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:32.787258 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eac5ee88-c174-4ff7-9e31-1a946c04d738 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:32.789319 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eac5ee88-c174-4ff7-9e31-1a946c04d738 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:32.803040 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eac5ee88-c174-4ff7-9e31-1a946c04d738 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:32.804499 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eac5ee88-c174-4ff7-9e31-1a946c04d738 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:32.805601 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eac5ee88-c174-4ff7-9e31-1a946c04d738 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:32.806589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eac5ee88-c174-4ff7-9e31-1a946c04d738 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:32.807357 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eac5ee88-c174-4ff7-9e31-1a946c04d738 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:32.807798 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-5984792d-50e6-4338-a1a3-3f6722cec043 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:32.808348 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eac5ee88-c174-4ff7-9e31-1a946c04d738 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:32.818597 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5984792d-50e6-4338-a1a3-3f6722cec043 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1683 microversion: 2.1 time: 0.185144 Aug 30 05:20:32.834035 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 501/972] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:32 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1683 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:33.039475 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eac5ee88-c174-4ff7-9e31-1a946c04d738 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:33.047682 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eac5ee88-c174-4ff7-9e31-1a946c04d738 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1265 microversion: 2.1 time: 0.267829 Aug 30 05:20:33.048558 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 472/973] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:32 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1265 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:33.674750 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-1c21506f-6c21-4d92-9e1a-ba580cfdf1f4 req-88b5ff38-d8f0-444f-9aa4-67de2a172e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44a2416-35ea-4b7d-b8b6-a68d9d578ca5", "name": "network-vif-plugged", "status": "completed", "tag": "7450aa1e-23d7-43dd-a88d-807ca70eed93"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:33.698848 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-1c21506f-6c21-4d92-9e1a-ba580cfdf1f4 req-88b5ff38-d8f0-444f-9aa4-67de2a172e37 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:33.699340 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-1c21506f-6c21-4d92-9e1a-ba580cfdf1f4 req-88b5ff38-d8f0-444f-9aa4-67de2a172e37 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:33.699767 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-1c21506f-6c21-4d92-9e1a-ba580cfdf1f4 req-88b5ff38-d8f0-444f-9aa4-67de2a172e37 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:33.717213 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-1c21506f-6c21-4d92-9e1a-ba580cfdf1f4 req-88b5ff38-d8f0-444f-9aa4-67de2a172e37 service nova] Creating event network-vif-plugged:7450aa1e-23d7-43dd-a88d-807ca70eed93 for instance d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 on hv-cinder-85391 Aug 30 05:20:33.723857 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-1c21506f-6c21-4d92-9e1a-ba580cfdf1f4 req-88b5ff38-d8f0-444f-9aa4-67de2a172e37 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053172 Aug 30 05:20:33.725194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 502/974] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:33.786133 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0e4a1670-5de6-439e-9abd-0fa7edaaa716 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1231379107"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:33.786764 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0e4a1670-5de6-439e-9abd-0fa7edaaa716 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:33.793207 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e4a1670-5de6-439e-9abd-0fa7edaaa716 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:33.793691 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e4a1670-5de6-439e-9abd-0fa7edaaa716 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:33.794125 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e4a1670-5de6-439e-9abd-0fa7edaaa716 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:33.794838 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e4a1670-5de6-439e-9abd-0fa7edaaa716 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:33.795297 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e4a1670-5de6-439e-9abd-0fa7edaaa716 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:33.795758 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e4a1670-5de6-439e-9abd-0fa7edaaa716 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:33.841689 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-741f70e8-0785-4d50-9094-9e9a49f94615 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:33.842424 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-741f70e8-0785-4d50-9094-9e9a49f94615 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:33.848913 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-741f70e8-0785-4d50-9094-9e9a49f94615 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:33.849372 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-741f70e8-0785-4d50-9094-9e9a49f94615 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:33.849816 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-741f70e8-0785-4d50-9094-9e9a49f94615 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:33.850519 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-741f70e8-0785-4d50-9094-9e9a49f94615 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:33.851027 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-741f70e8-0785-4d50-9094-9e9a49f94615 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:33.851460 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-741f70e8-0785-4d50-9094-9e9a49f94615 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:33.937525 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.network.security_group_api [None req-0e4a1670-5de6-439e-9abd-0fa7edaaa716 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Adding security group dbefcf5d-96fc-483e-9b27-47e5117d2b90 to port 71a60ab2-f1e6-480a-89ba-78b963887538 Aug 30 05:20:34.073760 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-741f70e8-0785-4d50-9094-9e9a49f94615 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:34.083659 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-741f70e8-0785-4d50-9094-9e9a49f94615 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1683 microversion: 2.1 time: 0.246319 Aug 30 05:20:34.098163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 503/975] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:33 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1683 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:20:34.103325 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c29d7a2c-9229-4bb7-baa6-13d5f62577d7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:34.103948 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c29d7a2c-9229-4bb7-baa6-13d5f62577d7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:34.109993 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c29d7a2c-9229-4bb7-baa6-13d5f62577d7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:34.111080 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c29d7a2c-9229-4bb7-baa6-13d5f62577d7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:34.111735 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c29d7a2c-9229-4bb7-baa6-13d5f62577d7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:34.112753 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c29d7a2c-9229-4bb7-baa6-13d5f62577d7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:34.113926 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c29d7a2c-9229-4bb7-baa6-13d5f62577d7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:34.114361 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c29d7a2c-9229-4bb7-baa6-13d5f62577d7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:34.398844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c29d7a2c-9229-4bb7-baa6-13d5f62577d7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:34.408759 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c29d7a2c-9229-4bb7-baa6-13d5f62577d7 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1265 microversion: 2.1 time: 0.309141 Aug 30 05:20:34.409437 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 504/976] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:34 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:34.577948 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0e4a1670-5de6-439e-9abd-0fa7edaaa716 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "POST /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/action" status: 202 len: 0 microversion: 2.1 time: 0.795742 Aug 30 05:20:34.582578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 473/977] 10.222.0.77 () {60 vars in 1278 bytes} [Tue Aug 30 05:20:33 2022] POST /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/action => generated 0 bytes in 798 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:20:34.587885 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6ede7e12-d628-402e-aaee-5694a6cb1ff9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:34.590005 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6ede7e12-d628-402e-aaee-5694a6cb1ff9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:34.598425 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ede7e12-d628-402e-aaee-5694a6cb1ff9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:34.601093 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-413306e8-f812-4f78-a2f8-5584dad266af req-db675658-ff66-4990-890a-ede5223d5c62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "565b3109-ab27-4465-aa1c-b4002d4e9792", "tag": "71a60ab2-f1e6-480a-89ba-78b963887538"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:34.604864 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ede7e12-d628-402e-aaee-5694a6cb1ff9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:34.604864 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ede7e12-d628-402e-aaee-5694a6cb1ff9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:34.605534 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ede7e12-d628-402e-aaee-5694a6cb1ff9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:34.605994 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ede7e12-d628-402e-aaee-5694a6cb1ff9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:34.606415 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6ede7e12-d628-402e-aaee-5694a6cb1ff9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:34.623406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-413306e8-f812-4f78-a2f8-5584dad266af req-db675658-ff66-4990-890a-ede5223d5c62 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:34.629440 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-413306e8-f812-4f78-a2f8-5584dad266af req-db675658-ff66-4990-890a-ede5223d5c62 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:34.630162 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-413306e8-f812-4f78-a2f8-5584dad266af req-db675658-ff66-4990-890a-ede5223d5c62 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:34.669945 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-413306e8-f812-4f78-a2f8-5584dad266af req-db675658-ff66-4990-890a-ede5223d5c62 service nova] Creating event network-changed:71a60ab2-f1e6-480a-89ba-78b963887538 for instance 565b3109-ab27-4465-aa1c-b4002d4e9792 on hv-cinder-85391 Aug 30 05:20:34.678438 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-413306e8-f812-4f78-a2f8-5584dad266af req-db675658-ff66-4990-890a-ede5223d5c62 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088672 Aug 30 05:20:34.680269 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 505/978] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:34.906782 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6ede7e12-d628-402e-aaee-5694a6cb1ff9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:34.918599 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6ede7e12-d628-402e-aaee-5694a6cb1ff9 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1642 microversion: 2.1 time: 0.334604 Aug 30 05:20:34.919333 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 474/979] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:34 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1642 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:35.106956 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-78389486-11dd-4a58-a783-1005e2da10cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:35.107875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-78389486-11dd-4a58-a783-1005e2da10cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:35.115551 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78389486-11dd-4a58-a783-1005e2da10cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:35.126853 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78389486-11dd-4a58-a783-1005e2da10cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:35.128141 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78389486-11dd-4a58-a783-1005e2da10cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:35.129199 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78389486-11dd-4a58-a783-1005e2da10cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:35.129780 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78389486-11dd-4a58-a783-1005e2da10cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:35.130441 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-78389486-11dd-4a58-a783-1005e2da10cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:35.372995 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-78389486-11dd-4a58-a783-1005e2da10cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:35.384328 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-78389486-11dd-4a58-a783-1005e2da10cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1683 microversion: 2.1 time: 0.282298 Aug 30 05:20:35.384918 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 506/980] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:35 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1683 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:35.431426 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-32bf2da1-0acb-44e2-87ab-4d184315ba47 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:35.432044 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-32bf2da1-0acb-44e2-87ab-4d184315ba47 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:35.437981 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32bf2da1-0acb-44e2-87ab-4d184315ba47 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:35.438522 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32bf2da1-0acb-44e2-87ab-4d184315ba47 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:35.438990 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32bf2da1-0acb-44e2-87ab-4d184315ba47 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:35.439697 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32bf2da1-0acb-44e2-87ab-4d184315ba47 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:35.440161 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32bf2da1-0acb-44e2-87ab-4d184315ba47 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:35.440591 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-32bf2da1-0acb-44e2-87ab-4d184315ba47 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:35.627227 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-32bf2da1-0acb-44e2-87ab-4d184315ba47 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:35.636498 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-32bf2da1-0acb-44e2-87ab-4d184315ba47 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1265 microversion: 2.1 time: 0.208802 Aug 30 05:20:35.637352 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 475/981] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:35 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:36.406050 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0bfebb05-7aa1-446c-bcbd-44131473007e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:36.406674 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0bfebb05-7aa1-446c-bcbd-44131473007e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:36.413198 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bfebb05-7aa1-446c-bcbd-44131473007e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:36.413683 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bfebb05-7aa1-446c-bcbd-44131473007e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:36.414155 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bfebb05-7aa1-446c-bcbd-44131473007e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:36.414874 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bfebb05-7aa1-446c-bcbd-44131473007e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:36.415327 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bfebb05-7aa1-446c-bcbd-44131473007e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:36.415947 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bfebb05-7aa1-446c-bcbd-44131473007e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:36.451654 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bfebb05-7aa1-446c-bcbd-44131473007e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:36.452133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bfebb05-7aa1-446c-bcbd-44131473007e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:36.452569 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0bfebb05-7aa1-446c-bcbd-44131473007e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:36.453022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-0bfebb05-7aa1-446c-bcbd-44131473007e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lazy-loading 'fault' on Instance uuid 4766e8f6-4e42-4773-bb22-b725770d2487 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:20:36.497430 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-0bfebb05-7aa1-446c-bcbd-44131473007e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:36.505672 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0bfebb05-7aa1-446c-bcbd-44131473007e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 200 len: 1332 microversion: 2.1 time: 0.103605 Aug 30 05:20:36.506376 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 507/982] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:36 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:36.657922 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e70c1d9e-5496-44dd-9b66-cd02cf6e318b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:36.658448 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e70c1d9e-5496-44dd-9b66-cd02cf6e318b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:36.664901 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e70c1d9e-5496-44dd-9b66-cd02cf6e318b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:36.665395 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e70c1d9e-5496-44dd-9b66-cd02cf6e318b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:36.665839 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e70c1d9e-5496-44dd-9b66-cd02cf6e318b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:36.666571 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e70c1d9e-5496-44dd-9b66-cd02cf6e318b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:36.667058 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e70c1d9e-5496-44dd-9b66-cd02cf6e318b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:36.667490 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e70c1d9e-5496-44dd-9b66-cd02cf6e318b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:36.721536 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-1101d7ba-db35-4c88-bfb8-b196a5482a4e req-77996102-7227-4988-99db-f947638af82a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4766e8f6-4e42-4773-bb22-b725770d2487", "name": "network-vif-deleted", "tag": "08c74dd1-5956-4921-97d8-5fa4c04b4949"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:36.731146 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-1101d7ba-db35-4c88-bfb8-b196a5482a4e req-77996102-7227-4988-99db-f947638af82a service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:36.731737 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-1101d7ba-db35-4c88-bfb8-b196a5482a4e req-77996102-7227-4988-99db-f947638af82a service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:36.732260 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-1101d7ba-db35-4c88-bfb8-b196a5482a4e req-77996102-7227-4988-99db-f947638af82a service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:36.746228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-1101d7ba-db35-4c88-bfb8-b196a5482a4e req-77996102-7227-4988-99db-f947638af82a service nova] Creating event network-vif-deleted:08c74dd1-5956-4921-97d8-5fa4c04b4949 for instance 4766e8f6-4e42-4773-bb22-b725770d2487 on hv-cinder-85391 Aug 30 05:20:36.751254 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-1101d7ba-db35-4c88-bfb8-b196a5482a4e req-77996102-7227-4988-99db-f947638af82a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035006 Aug 30 05:20:36.751890 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 508/983] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:36.812095 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e70c1d9e-5496-44dd-9b66-cd02cf6e318b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:36.820213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e70c1d9e-5496-44dd-9b66-cd02cf6e318b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1453 microversion: 2.1 time: 0.166728 Aug 30 05:20:36.820780 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 476/984] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:36 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:36.841437 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c72421bf-3ebd-4176-9819-ce638bf1865b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:36.842135 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c72421bf-3ebd-4176-9819-ce638bf1865b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:36.848883 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c72421bf-3ebd-4176-9819-ce638bf1865b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:36.849365 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c72421bf-3ebd-4176-9819-ce638bf1865b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:36.849803 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c72421bf-3ebd-4176-9819-ce638bf1865b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:36.850492 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c72421bf-3ebd-4176-9819-ce638bf1865b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:36.850970 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c72421bf-3ebd-4176-9819-ce638bf1865b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:36.851400 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c72421bf-3ebd-4176-9819-ce638bf1865b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:36.982375 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c72421bf-3ebd-4176-9819-ce638bf1865b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:36.990362 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c72421bf-3ebd-4176-9819-ce638bf1865b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1453 microversion: 2.1 time: 0.153313 Aug 30 05:20:36.990948 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 509/985] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:36 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:20:37.526603 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-03ea2ca7-1605-44e0-ab59-5937cfb051c7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:37.527251 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-03ea2ca7-1605-44e0-ab59-5937cfb051c7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:37.533371 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03ea2ca7-1605-44e0-ab59-5937cfb051c7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:37.533858 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03ea2ca7-1605-44e0-ab59-5937cfb051c7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:37.534303 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03ea2ca7-1605-44e0-ab59-5937cfb051c7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:37.535040 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03ea2ca7-1605-44e0-ab59-5937cfb051c7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:37.535491 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03ea2ca7-1605-44e0-ab59-5937cfb051c7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:37.535970 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-03ea2ca7-1605-44e0-ab59-5937cfb051c7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:37.550020 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-03ea2ca7-1605-44e0-ab59-5937cfb051c7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] HTTP exception thrown: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-03ea2ca7-1605-44e0-ab59-5937cfb051c7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Request method failure captured: Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 HTTP/1.1 Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZ1_BwqBAvo25XUAt_hPX0zVighjm0QlniWU-jqAI4fG3e31IXufsUyXytncyQcNIsqbFJosPnnVGxtyzcvHCLdS0OGpuhx6w1qakeVZUvmKyNmZ6a2aA0JwLTrTvk1kHTprNY5RT9dfrhFGUO0IJBcYTYeHf_BQhuD-oVr-rD2jMpc Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:20:37.551702 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:20:37.553378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bebd859c24cd4ed3b7e32a82de820b8a", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:20:37.553378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:20:37.553378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:20:37.553378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:20:37.553378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:20:37.553378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:20:37.553378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:20:37.553378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: d079e0264f0e40db9fc93b8f217a7a74 Aug 30 05:20:37.553378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:20:37.553378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:20:37.553378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. Aug 30 05:20:37.553378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': '4766e8f6-4e42-4773-bb22-b725770d2487'} Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:20:37.554581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. Aug 30 05:20:37.556140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:20:37.557578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-03ea2ca7-1605-44e0-ab59-5937cfb051c7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Returning 404 to user: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:20:37.557578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-03ea2ca7-1605-44e0-ab59-5937cfb051c7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 404 len: 111 microversion: 2.1 time: 0.030378 Aug 30 05:20:37.557578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 477/986] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:37 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:20:37.562498 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-08ebe7ab-d678-4929-87b0-d957cd77acae tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '.version_select at 0x7f822edb4430>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:37.582198 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-08ebe7ab-d678-4929-87b0-d957cd77acae tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1986712859" status: 202 len: 0 microversion: 2.1 time: 0.023546 Aug 30 05:20:37.582776 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 510/987] 10.222.0.77 () {58 vars in 1221 bytes} [Tue Aug 30 05:20:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1986712859 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:20:38.279214 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-51828db4-b684-4737-91d8-1b788f188c45 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:38.279787 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-51828db4-b684-4737-91d8-1b788f188c45 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:38.286168 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51828db4-b684-4737-91d8-1b788f188c45 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:38.286729 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51828db4-b684-4737-91d8-1b788f188c45 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:38.287189 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51828db4-b684-4737-91d8-1b788f188c45 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:38.287889 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51828db4-b684-4737-91d8-1b788f188c45 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:38.288334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51828db4-b684-4737-91d8-1b788f188c45 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:38.288763 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51828db4-b684-4737-91d8-1b788f188c45 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:38.377308 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-51828db4-b684-4737-91d8-1b788f188c45 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lazy-loading 'services' on Instance uuid cd7486a8-b5d7-45e0-921a-6621d9a10233 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:20:38.385949 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:38.465910 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-51828db4-b684-4737-91d8-1b788f188c45 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "DELETE /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233/os-volume_attachments/dd89bd10-7ba1-46bc-a203-52fa3deccbf4" status: 202 len: 0 microversion: 2.1 time: 0.190019 Aug 30 05:20:38.467221 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 478/988] 10.222.0.77 () {58 vars in 1416 bytes} [Tue Aug 30 05:20:38 2022] DELETE /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233/os-volume_attachments/dd89bd10-7ba1-46bc-a203-52fa3deccbf4 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:20:38.475821 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b7e2abe1-5349-40e4-a911-064f58ccecff tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:38.478290 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b7e2abe1-5349-40e4-a911-064f58ccecff tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:38.485937 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7e2abe1-5349-40e4-a911-064f58ccecff tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:38.486623 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7e2abe1-5349-40e4-a911-064f58ccecff tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:38.487189 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7e2abe1-5349-40e4-a911-064f58ccecff tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:38.488339 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7e2abe1-5349-40e4-a911-064f58ccecff tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:38.488845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7e2abe1-5349-40e4-a911-064f58ccecff tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:38.489635 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b7e2abe1-5349-40e4-a911-064f58ccecff tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:38.516411 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:38.523682 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b7e2abe1-5349-40e4-a911-064f58ccecff tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051887 Aug 30 05:20:38.524253 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 511/989] 10.222.0.77 () {58 vars in 1302 bytes} [Tue Aug 30 05:20:38 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:20:39.032029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-339a1edc-d155-44fe-ab3a-3dff69400096 req-452b8ca6-692d-4011-b411-513db93de22a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d44a2416-35ea-4b7d-b8b6-a68d9d578ca5", "tag": "7450aa1e-23d7-43dd-a88d-807ca70eed93"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:39.044679 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-339a1edc-d155-44fe-ab3a-3dff69400096 req-452b8ca6-692d-4011-b411-513db93de22a service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:39.045378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-339a1edc-d155-44fe-ab3a-3dff69400096 req-452b8ca6-692d-4011-b411-513db93de22a service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:39.045808 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-339a1edc-d155-44fe-ab3a-3dff69400096 req-452b8ca6-692d-4011-b411-513db93de22a service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:39.057039 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-339a1edc-d155-44fe-ab3a-3dff69400096 req-452b8ca6-692d-4011-b411-513db93de22a service nova] Creating event network-changed:7450aa1e-23d7-43dd-a88d-807ca70eed93 for instance d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 on hv-cinder-85391 Aug 30 05:20:39.061819 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-339a1edc-d155-44fe-ab3a-3dff69400096 req-452b8ca6-692d-4011-b411-513db93de22a service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033700 Aug 30 05:20:39.062586 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 479/990] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:39.536316 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0f8a5ba2-2aef-4fb4-8212-201a08b0ca86 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:39.538584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-0f8a5ba2-2aef-4fb4-8212-201a08b0ca86 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:39.545916 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f8a5ba2-2aef-4fb4-8212-201a08b0ca86 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:39.546412 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f8a5ba2-2aef-4fb4-8212-201a08b0ca86 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:39.546945 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f8a5ba2-2aef-4fb4-8212-201a08b0ca86 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:39.547689 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f8a5ba2-2aef-4fb4-8212-201a08b0ca86 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:39.548389 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f8a5ba2-2aef-4fb4-8212-201a08b0ca86 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:39.549053 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-0f8a5ba2-2aef-4fb4-8212-201a08b0ca86 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:39.580874 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0f8a5ba2-2aef-4fb4-8212-201a08b0ca86 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048434 Aug 30 05:20:39.581845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 512/991] 10.222.0.77 () {58 vars in 1302 bytes} [Tue Aug 30 05:20:39 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 05:20:39.651140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f5472680-efdb-4be8-8a31-3fa87a6d40fb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:39.651731 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f5472680-efdb-4be8-8a31-3fa87a6d40fb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:39.657864 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5472680-efdb-4be8-8a31-3fa87a6d40fb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:39.658353 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5472680-efdb-4be8-8a31-3fa87a6d40fb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:39.658791 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5472680-efdb-4be8-8a31-3fa87a6d40fb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:39.659697 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5472680-efdb-4be8-8a31-3fa87a6d40fb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:39.660160 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5472680-efdb-4be8-8a31-3fa87a6d40fb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:39.660590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f5472680-efdb-4be8-8a31-3fa87a6d40fb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:39.685745 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f5472680-efdb-4be8-8a31-3fa87a6d40fb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:20:39.762846 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f5472680-efdb-4be8-8a31-3fa87a6d40fb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "DELETE /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 204 len: 0 microversion: 2.1 time: 0.116030 Aug 30 05:20:39.763651 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 480/992] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:20:39 2022] DELETE /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:20:39.772063 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-13d5f2af-38cc-43d8-96cb-4877be2e2f7f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:39.772706 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-13d5f2af-38cc-43d8-96cb-4877be2e2f7f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:39.778952 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13d5f2af-38cc-43d8-96cb-4877be2e2f7f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:39.779521 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13d5f2af-38cc-43d8-96cb-4877be2e2f7f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:39.780079 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13d5f2af-38cc-43d8-96cb-4877be2e2f7f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:39.780883 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13d5f2af-38cc-43d8-96cb-4877be2e2f7f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:39.781412 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13d5f2af-38cc-43d8-96cb-4877be2e2f7f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:39.781881 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-13d5f2af-38cc-43d8-96cb-4877be2e2f7f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:39.919876 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-13d5f2af-38cc-43d8-96cb-4877be2e2f7f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:39.928474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-13d5f2af-38cc-43d8-96cb-4877be2e2f7f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1681 microversion: 2.1 time: 0.160339 Aug 30 05:20:39.929058 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 513/993] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:39 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:40.951345 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-da9860e6-9fc6-4bd8-a12d-981b66f59930 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:40.952099 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-da9860e6-9fc6-4bd8-a12d-981b66f59930 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:40.958978 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da9860e6-9fc6-4bd8-a12d-981b66f59930 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:40.959456 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da9860e6-9fc6-4bd8-a12d-981b66f59930 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:40.959884 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da9860e6-9fc6-4bd8-a12d-981b66f59930 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:40.960568 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da9860e6-9fc6-4bd8-a12d-981b66f59930 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:40.961023 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da9860e6-9fc6-4bd8-a12d-981b66f59930 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:40.961444 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-da9860e6-9fc6-4bd8-a12d-981b66f59930 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:41.092666 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-da9860e6-9fc6-4bd8-a12d-981b66f59930 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:41.100258 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-da9860e6-9fc6-4bd8-a12d-981b66f59930 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1681 microversion: 2.1 time: 0.153220 Aug 30 05:20:41.100934 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 481/994] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:40 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:42.121430 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b0e02fe3-bcb6-4bff-b727-508207b7a97c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:42.122104 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b0e02fe3-bcb6-4bff-b727-508207b7a97c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:42.128703 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0e02fe3-bcb6-4bff-b727-508207b7a97c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:42.129192 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0e02fe3-bcb6-4bff-b727-508207b7a97c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:42.129675 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0e02fe3-bcb6-4bff-b727-508207b7a97c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:42.130367 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0e02fe3-bcb6-4bff-b727-508207b7a97c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:42.130834 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0e02fe3-bcb6-4bff-b727-508207b7a97c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:42.131254 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b0e02fe3-bcb6-4bff-b727-508207b7a97c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:42.220791 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b0e02fe3-bcb6-4bff-b727-508207b7a97c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:42.228474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b0e02fe3-bcb6-4bff-b727-508207b7a97c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 200 len: 1613 microversion: 2.1 time: 0.110963 Aug 30 05:20:42.229049 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 514/995] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:42 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 1613 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:42.329933 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-0a5a870c-d7f1-4e3d-9f40-5cf95ca559d2 req-18d3d895-8c5c-4a0b-9685-fa9a1d069bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd7486a8-b5d7-45e0-921a-6621d9a10233", "name": "network-vif-deleted", "tag": "aa613a15-0a05-4d3e-be80-89172048cffe"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:42.340001 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-0a5a870c-d7f1-4e3d-9f40-5cf95ca559d2 req-18d3d895-8c5c-4a0b-9685-fa9a1d069bb8 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:42.340476 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-0a5a870c-d7f1-4e3d-9f40-5cf95ca559d2 req-18d3d895-8c5c-4a0b-9685-fa9a1d069bb8 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:42.340907 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-0a5a870c-d7f1-4e3d-9f40-5cf95ca559d2 req-18d3d895-8c5c-4a0b-9685-fa9a1d069bb8 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:42.354113 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-0a5a870c-d7f1-4e3d-9f40-5cf95ca559d2 req-18d3d895-8c5c-4a0b-9685-fa9a1d069bb8 service nova] Creating event network-vif-deleted:aa613a15-0a05-4d3e-be80-89172048cffe for instance cd7486a8-b5d7-45e0-921a-6621d9a10233 on hv-cinder-85391 Aug 30 05:20:42.359109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-0a5a870c-d7f1-4e3d-9f40-5cf95ca559d2 req-18d3d895-8c5c-4a0b-9685-fa9a1d069bb8 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033275 Aug 30 05:20:42.360174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 482/996] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:43.249652 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bc428012-a306-4667-a26d-c6578588f21f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:43.250561 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-bc428012-a306-4667-a26d-c6578588f21f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:43.257775 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc428012-a306-4667-a26d-c6578588f21f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:43.259047 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc428012-a306-4667-a26d-c6578588f21f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:43.259663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc428012-a306-4667-a26d-c6578588f21f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:43.260377 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc428012-a306-4667-a26d-c6578588f21f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:43.260872 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc428012-a306-4667-a26d-c6578588f21f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:43.261283 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-bc428012-a306-4667-a26d-c6578588f21f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:43.275491 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-bc428012-a306-4667-a26d-c6578588f21f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] HTTP exception thrown: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bc428012-a306-4667-a26d-c6578588f21f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Request method failure captured: Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 HTTP/1.1 Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZ1_BwqBAvo25XUAt_hPX0zVighjm0QlniWU-jqAI4fG3e31IXufsUyXytncyQcNIsqbFJosPnnVGxtyzcvHCLdS0OGpuhx6w1qakeVZUvmKyNmZ6a2aA0JwLTrTvk1kHTprNY5RT9dfrhFGUO0IJBcYTYeHf_BQhuD-oVr-rD2jMpc Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:20:43.277478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:20:43.279123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bebd859c24cd4ed3b7e32a82de820b8a", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:20:43.279123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:20:43.279123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:20:43.279123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:20:43.279123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:20:43.279123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:20:43.279123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:20:43.279123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: d079e0264f0e40db9fc93b8f217a7a74 Aug 30 05:20:43.279123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:20:43.279123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:20:43.279123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. Aug 30 05:20:43.279123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': 'cd7486a8-b5d7-45e0-921a-6621d9a10233'} Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:20:43.284105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. Aug 30 05:20:43.285593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:20:43.286971 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-bc428012-a306-4667-a26d-c6578588f21f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Returning 404 to user: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:20:43.286971 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-bc428012-a306-4667-a26d-c6578588f21f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 404 len: 111 microversion: 2.1 time: 0.033373 Aug 30 05:20:43.286971 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 515/997] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:43 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:20:43.289534 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a77ef8fe-7cf7-4e61-9ee0-9f4b4b702649 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '.version_select at 0x7f822ed6d430>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:43.294586 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:20:43.294747 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Tue Aug 30 05:20:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-79741342 (ip 10.222.0.77) !!! Aug 30 05:20:43.311331 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a77ef8fe-7cf7-4e61-9ee0-9f4b4b702649 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-79741342" status: 202 len: 0 microversion: 2.1 time: 0.026501 Aug 30 05:20:43.311845 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 483/998] 10.222.0.77 () {58 vars in 1215 bytes} [Tue Aug 30 05:20:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-79741342 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:20:43.933789 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-0b7a0ee2-0e57-43b7-b3e8-4ec7763582ab tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Action: 'create', calling method: .version_select at 0x7f822edf7550>, body: {"keypair": {"name": "tempest-keypair-519516746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6/6Wf0XbvX8D4QcgB+XoxxHZv3o3GBaY75Qv3Nbs8pny/mITY9d+vvx8//CyxEpA4Jeo1hmQrlF/kJKuBIyqTAcfrc4AlSiHMug26btZMRB6KqjKaJBSl7UxjpZSPUKw=="}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:43.954911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-0b7a0ee2-0e57-43b7-b3e8-4ec7763582ab tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Getting quotas for project bebd859c24cd4ed3b7e32a82de820b8a. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:20:43.958639 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-0b7a0ee2-0e57-43b7-b3e8-4ec7763582ab tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Getting quotas for user d079e0264f0e40db9fc93b8f217a7a74 and project bebd859c24cd4ed3b7e32a82de820b8a. Resources: {'key_pairs'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:20:43.981342 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-0b7a0ee2-0e57-43b7-b3e8-4ec7763582ab tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057394 Aug 30 05:20:43.981931 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 516/999] 10.222.0.77 () {60 vars in 1159 bytes} [Tue Aug 30 05:20:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:45.219022 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-577036111", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff2f7ffd-21e7-4f75-8a8d-ab24ee6942f2"}], "security_groups": [{"name": "tempest-securitygroup--1909112318"}], "key_name": "tempest-keypair-519516746", "user_data": "}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:45.324029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.network.neutron [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] validate_networks() for [('ff2f7ffd-21e7-4f75-8a8d-ab24ee6942f2', None, None, None, None, None)] {{(pid=120573) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:20:45.683336 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Flavor limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:20:45.683763 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Image limits 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:20:45.684238 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Flavor pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:20:45.684645 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Image pref 0:0:0 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:20:45.685057 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.virt.hardware [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120573) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:20:45.694283 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:45.694774 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:45.695240 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:45.695964 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:45.696421 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:45.696844 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:45.713493 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Getting quotas for project bebd859c24cd4ed3b7e32a82de820b8a. Resources: {'instances', 'ram', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:20:45.717867 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Getting quotas for user d079e0264f0e40db9fc93b8f217a7a74 and project bebd859c24cd4ed3b7e32a82de820b8a. Resources: {'instances', 'ram', 'cores'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:20:45.729038 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Going to run 1 instances... {{(pid=120573) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:20:45.731406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120573) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:20:45.779761 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-58815f6a-49ee-4c0d-ae4c-d0b302cf08ec tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.565942 Aug 30 05:20:45.780397 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 484/1000] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:20:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:20:45.791593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-90911402-c89b-449e-b428-6c8c48606f15 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:45.792299 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-90911402-c89b-449e-b428-6c8c48606f15 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:45.848936 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-90911402-c89b-449e-b428-6c8c48606f15 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:45.858295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-90911402-c89b-449e-b428-6c8c48606f15 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 200 len: 1240 microversion: 2.1 time: 0.071090 Aug 30 05:20:45.858882 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 517/1001] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:45 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:46.880527 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ec1bfa49-3d5e-4d22-9d47-94e39a059f09 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:46.881236 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ec1bfa49-3d5e-4d22-9d47-94e39a059f09 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:46.887609 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec1bfa49-3d5e-4d22-9d47-94e39a059f09 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:46.888188 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec1bfa49-3d5e-4d22-9d47-94e39a059f09 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:46.888690 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec1bfa49-3d5e-4d22-9d47-94e39a059f09 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:46.889453 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec1bfa49-3d5e-4d22-9d47-94e39a059f09 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:46.889972 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec1bfa49-3d5e-4d22-9d47-94e39a059f09 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:46.890462 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ec1bfa49-3d5e-4d22-9d47-94e39a059f09 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:46.956119 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ec1bfa49-3d5e-4d22-9d47-94e39a059f09 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:46.963843 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ec1bfa49-3d5e-4d22-9d47-94e39a059f09 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 200 len: 1310 microversion: 2.1 time: 0.088096 Aug 30 05:20:46.964853 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 485/1002] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:46 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:47.985006 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-14db3b87-7675-4f0c-8870-419cc170da84 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:47.985562 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-14db3b87-7675-4f0c-8870-419cc170da84 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:47.992390 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14db3b87-7675-4f0c-8870-419cc170da84 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:47.992879 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14db3b87-7675-4f0c-8870-419cc170da84 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:47.993459 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14db3b87-7675-4f0c-8870-419cc170da84 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:47.994170 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14db3b87-7675-4f0c-8870-419cc170da84 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:47.994656 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14db3b87-7675-4f0c-8870-419cc170da84 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:47.995115 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-14db3b87-7675-4f0c-8870-419cc170da84 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:48.182293 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-14db3b87-7675-4f0c-8870-419cc170da84 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:48.190468 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-14db3b87-7675-4f0c-8870-419cc170da84 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 200 len: 1366 microversion: 2.1 time: 0.209563 Aug 30 05:20:48.191067 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 518/1003] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:47 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:48.470960 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-431e83bc-40d9-4005-9a2f-31d3e501a6c5 req-04143be9-aeb4-4447-ac4d-7361bcd4228d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609ae0b0-7ae0-4849-b6c0-47a80959c070", "tag": "a1156e08-a434-4102-a3ae-9e9dc323ddf6"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:48.481007 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-431e83bc-40d9-4005-9a2f-31d3e501a6c5 req-04143be9-aeb4-4447-ac4d-7361bcd4228d service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:48.481488 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-431e83bc-40d9-4005-9a2f-31d3e501a6c5 req-04143be9-aeb4-4447-ac4d-7361bcd4228d service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:48.482345 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-431e83bc-40d9-4005-9a2f-31d3e501a6c5 req-04143be9-aeb4-4447-ac4d-7361bcd4228d service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:48.495920 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-431e83bc-40d9-4005-9a2f-31d3e501a6c5 req-04143be9-aeb4-4447-ac4d-7361bcd4228d service nova] Creating event network-changed:a1156e08-a434-4102-a3ae-9e9dc323ddf6 for instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 on hv-cinder-85391 Aug 30 05:20:48.500505 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-431e83bc-40d9-4005-9a2f-31d3e501a6c5 req-04143be9-aeb4-4447-ac4d-7361bcd4228d service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040313 Aug 30 05:20:48.501099 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 486/1004] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:49.211520 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ab1c73a9-4986-433e-babc-4a643befb790 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:49.212135 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ab1c73a9-4986-433e-babc-4a643befb790 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:49.219338 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab1c73a9-4986-433e-babc-4a643befb790 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:49.219818 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab1c73a9-4986-433e-babc-4a643befb790 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:49.220250 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab1c73a9-4986-433e-babc-4a643befb790 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:49.220936 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab1c73a9-4986-433e-babc-4a643befb790 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:49.221392 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab1c73a9-4986-433e-babc-4a643befb790 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:49.221813 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ab1c73a9-4986-433e-babc-4a643befb790 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:49.347579 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ab1c73a9-4986-433e-babc-4a643befb790 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:49.355107 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ab1c73a9-4986-433e-babc-4a643befb790 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 200 len: 1366 microversion: 2.1 time: 0.147640 Aug 30 05:20:49.355670 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 519/1005] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:49 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:50.376415 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-5df2f972-d6ce-4eab-830c-0e8ad4700652 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:50.377100 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-5df2f972-d6ce-4eab-830c-0e8ad4700652 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:50.383149 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5df2f972-d6ce-4eab-830c-0e8ad4700652 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:50.383628 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5df2f972-d6ce-4eab-830c-0e8ad4700652 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:50.384059 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5df2f972-d6ce-4eab-830c-0e8ad4700652 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:50.384735 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5df2f972-d6ce-4eab-830c-0e8ad4700652 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:50.385184 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5df2f972-d6ce-4eab-830c-0e8ad4700652 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:50.385603 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-5df2f972-d6ce-4eab-830c-0e8ad4700652 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:50.658367 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-5df2f972-d6ce-4eab-830c-0e8ad4700652 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:50.665870 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-5df2f972-d6ce-4eab-830c-0e8ad4700652 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 200 len: 1366 microversion: 2.1 time: 0.294145 Aug 30 05:20:50.666422 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 487/1006] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:50 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:51.685446 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-88a161c8-faff-4563-95fa-6b3d691709d7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:51.686084 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-88a161c8-faff-4563-95fa-6b3d691709d7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:51.688387 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:51.693710 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88a161c8-faff-4563-95fa-6b3d691709d7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:51.694192 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88a161c8-faff-4563-95fa-6b3d691709d7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:51.694690 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88a161c8-faff-4563-95fa-6b3d691709d7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:51.695417 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88a161c8-faff-4563-95fa-6b3d691709d7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:51.695933 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88a161c8-faff-4563-95fa-6b3d691709d7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:51.696277 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-88a161c8-faff-4563-95fa-6b3d691709d7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:51.831685 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-88a161c8-faff-4563-95fa-6b3d691709d7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:51.839626 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-88a161c8-faff-4563-95fa-6b3d691709d7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 200 len: 1366 microversion: 2.1 time: 0.157812 Aug 30 05:20:51.840185 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 520/1007] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:51 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:52.861307 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e4740351-92ac-4e82-860e-387512c6b9c3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:52.861922 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e4740351-92ac-4e82-860e-387512c6b9c3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:52.864353 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:52.869495 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4740351-92ac-4e82-860e-387512c6b9c3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:52.869978 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4740351-92ac-4e82-860e-387512c6b9c3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:52.870436 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4740351-92ac-4e82-860e-387512c6b9c3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:52.871139 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4740351-92ac-4e82-860e-387512c6b9c3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:52.871596 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4740351-92ac-4e82-860e-387512c6b9c3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:52.872022 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e4740351-92ac-4e82-860e-387512c6b9c3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:53.002261 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e4740351-92ac-4e82-860e-387512c6b9c3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:53.009762 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e4740351-92ac-4e82-860e-387512c6b9c3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 200 len: 1366 microversion: 2.1 time: 0.152966 Aug 30 05:20:53.010315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 488/1008] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:52 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:53.721235 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-4ca47026-e1b5-4269-9b54-ae74c5fced5d req-f5c3e381-7243-423a-b9f3-1a3b4387a48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609ae0b0-7ae0-4849-b6c0-47a80959c070", "name": "network-vif-plugged", "status": "completed", "tag": "a1156e08-a434-4102-a3ae-9e9dc323ddf6"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:53.731631 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-4ca47026-e1b5-4269-9b54-ae74c5fced5d req-f5c3e381-7243-423a-b9f3-1a3b4387a48c service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:53.732118 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-4ca47026-e1b5-4269-9b54-ae74c5fced5d req-f5c3e381-7243-423a-b9f3-1a3b4387a48c service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:53.732688 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-4ca47026-e1b5-4269-9b54-ae74c5fced5d req-f5c3e381-7243-423a-b9f3-1a3b4387a48c service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:53.744064 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-4ca47026-e1b5-4269-9b54-ae74c5fced5d req-f5c3e381-7243-423a-b9f3-1a3b4387a48c service nova] Creating event network-vif-plugged:a1156e08-a434-4102-a3ae-9e9dc323ddf6 for instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 on hv-cinder-85391 Aug 30 05:20:53.748991 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-4ca47026-e1b5-4269-9b54-ae74c5fced5d req-f5c3e381-7243-423a-b9f3-1a3b4387a48c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031518 Aug 30 05:20:53.749570 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 521/1009] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:54.029594 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-87984668-52ca-459f-9615-bc7e460f5947 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:54.030207 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-87984668-52ca-459f-9615-bc7e460f5947 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:54.037099 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87984668-52ca-459f-9615-bc7e460f5947 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:54.037473 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87984668-52ca-459f-9615-bc7e460f5947 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:54.037908 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87984668-52ca-459f-9615-bc7e460f5947 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:54.038607 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87984668-52ca-459f-9615-bc7e460f5947 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:54.039105 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87984668-52ca-459f-9615-bc7e460f5947 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:54.039537 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-87984668-52ca-459f-9615-bc7e460f5947 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:54.164657 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-87984668-52ca-459f-9615-bc7e460f5947 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:54.172747 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-87984668-52ca-459f-9615-bc7e460f5947 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 200 len: 1366 microversion: 2.1 time: 0.146536 Aug 30 05:20:54.173305 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 489/1010] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:54 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:55.194579 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a7195863-6a1d-42c7-9259-6b1dad3ed3f0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:55.195328 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a7195863-6a1d-42c7-9259-6b1dad3ed3f0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:55.201794 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7195863-6a1d-42c7-9259-6b1dad3ed3f0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:55.201953 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7195863-6a1d-42c7-9259-6b1dad3ed3f0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:55.202394 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7195863-6a1d-42c7-9259-6b1dad3ed3f0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:55.203103 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7195863-6a1d-42c7-9259-6b1dad3ed3f0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:55.204213 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7195863-6a1d-42c7-9259-6b1dad3ed3f0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:55.204643 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a7195863-6a1d-42c7-9259-6b1dad3ed3f0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:55.336669 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a7195863-6a1d-42c7-9259-6b1dad3ed3f0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:55.344554 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a7195863-6a1d-42c7-9259-6b1dad3ed3f0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 200 len: 1366 microversion: 2.1 time: 0.154817 Aug 30 05:20:55.345115 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 522/1011] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:55 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:56.365215 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-165aa4ed-1b11-4737-84e8-ff9039e22108 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:56.365830 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-165aa4ed-1b11-4737-84e8-ff9039e22108 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:56.368026 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:56.368665 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=6 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:56.374378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-165aa4ed-1b11-4737-84e8-ff9039e22108 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:56.374877 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-165aa4ed-1b11-4737-84e8-ff9039e22108 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:56.375312 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-165aa4ed-1b11-4737-84e8-ff9039e22108 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:56.375999 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-165aa4ed-1b11-4737-84e8-ff9039e22108 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:56.376450 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-165aa4ed-1b11-4737-84e8-ff9039e22108 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:56.376869 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-165aa4ed-1b11-4737-84e8-ff9039e22108 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:56.504499 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-165aa4ed-1b11-4737-84e8-ff9039e22108 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:56.512093 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-165aa4ed-1b11-4737-84e8-ff9039e22108 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 200 len: 1556 microversion: 2.1 time: 0.150724 Aug 30 05:20:56.512652 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 490/1012] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:56 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:56.532781 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b50a6a11-1f7b-4aba-b7fc-254bffa545eb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:56.533276 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b50a6a11-1f7b-4aba-b7fc-254bffa545eb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:56.535253 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:20:56.541184 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b50a6a11-1f7b-4aba-b7fc-254bffa545eb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:56.541672 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b50a6a11-1f7b-4aba-b7fc-254bffa545eb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:56.542106 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b50a6a11-1f7b-4aba-b7fc-254bffa545eb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:56.542790 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b50a6a11-1f7b-4aba-b7fc-254bffa545eb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:56.543272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b50a6a11-1f7b-4aba-b7fc-254bffa545eb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:56.543693 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b50a6a11-1f7b-4aba-b7fc-254bffa545eb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:56.619635 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b50a6a11-1f7b-4aba-b7fc-254bffa545eb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091398 Aug 30 05:20:56.620261 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 523/1013] 10.222.0.77 () {58 vars in 1275 bytes} [Tue Aug 30 05:20:56 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:57.521821 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-2595b029-a05a-4f1a-ae8f-08c7c89a8976 req-d5daa47c-2c89-4bc9-a6e1-7875e72dd2a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "609ae0b0-7ae0-4849-b6c0-47a80959c070", "tag": "a1156e08-a434-4102-a3ae-9e9dc323ddf6"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:57.532098 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-2595b029-a05a-4f1a-ae8f-08c7c89a8976 req-d5daa47c-2c89-4bc9-a6e1-7875e72dd2a0 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:57.532680 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-2595b029-a05a-4f1a-ae8f-08c7c89a8976 req-d5daa47c-2c89-4bc9-a6e1-7875e72dd2a0 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:57.533182 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-2595b029-a05a-4f1a-ae8f-08c7c89a8976 req-d5daa47c-2c89-4bc9-a6e1-7875e72dd2a0 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:57.543915 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-2595b029-a05a-4f1a-ae8f-08c7c89a8976 req-d5daa47c-2c89-4bc9-a6e1-7875e72dd2a0 service nova] Creating event network-changed:a1156e08-a434-4102-a3ae-9e9dc323ddf6 for instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 on hv-cinder-85391 Aug 30 05:20:57.549709 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-2595b029-a05a-4f1a-ae8f-08c7c89a8976 req-d5daa47c-2c89-4bc9-a6e1-7875e72dd2a0 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031574 Aug 30 05:20:57.550307 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 491/1014] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:20:57.563327 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ca6b9302-d8f0-47a1-8e61-b32187ccd991 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:20:57.565577 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ca6b9302-d8f0-47a1-8e61-b32187ccd991 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:57.572593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca6b9302-d8f0-47a1-8e61-b32187ccd991 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:57.573081 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca6b9302-d8f0-47a1-8e61-b32187ccd991 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:57.573532 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca6b9302-d8f0-47a1-8e61-b32187ccd991 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:57.574430 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca6b9302-d8f0-47a1-8e61-b32187ccd991 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:57.574895 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca6b9302-d8f0-47a1-8e61-b32187ccd991 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:57.575638 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ca6b9302-d8f0-47a1-8e61-b32187ccd991 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:57.657541 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ca6b9302-d8f0-47a1-8e61-b32187ccd991 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "POST /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/action" status: 202 len: 0 microversion: 2.1 time: 0.097467 Aug 30 05:20:57.658802 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 524/1015] 10.222.0.77 () {60 vars in 1278 bytes} [Tue Aug 30 05:20:57 2022] POST /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:20:57.667127 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-af8de9bf-c202-40a3-88ff-161c63fd7a4f tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:57.668116 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-af8de9bf-c202-40a3-88ff-161c63fd7a4f tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:57.676992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-af8de9bf-c202-40a3-88ff-161c63fd7a4f tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:57.678511 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-af8de9bf-c202-40a3-88ff-161c63fd7a4f tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:57.679312 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-af8de9bf-c202-40a3-88ff-161c63fd7a4f tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:57.680209 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-af8de9bf-c202-40a3-88ff-161c63fd7a4f tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:57.680833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-af8de9bf-c202-40a3-88ff-161c63fd7a4f tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:57.681524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-af8de9bf-c202-40a3-88ff-161c63fd7a4f tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:57.942776 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-af8de9bf-c202-40a3-88ff-161c63fd7a4f tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:57.954116 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-af8de9bf-c202-40a3-88ff-161c63fd7a4f tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1752 microversion: 2.1 time: 0.290474 Aug 30 05:20:57.967023 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 492/1016] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:57 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1752 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:20:58.976982 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3645b959-e07f-491e-a228-b1619558591d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:20:58.977684 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3645b959-e07f-491e-a228-b1619558591d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:20:58.983795 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3645b959-e07f-491e-a228-b1619558591d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:58.984279 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3645b959-e07f-491e-a228-b1619558591d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:58.985316 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3645b959-e07f-491e-a228-b1619558591d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:58.986004 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3645b959-e07f-491e-a228-b1619558591d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:20:58.986458 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3645b959-e07f-491e-a228-b1619558591d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:20:58.986907 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3645b959-e07f-491e-a228-b1619558591d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:20:59.125349 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-3645b959-e07f-491e-a228-b1619558591d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:20:59.133465 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3645b959-e07f-491e-a228-b1619558591d tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1757 microversion: 2.1 time: 0.161197 Aug 30 05:20:59.134025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 525/1017] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:20:58 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:00.154113 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-818bf7c6-6c1b-4789-abd1-8e06a0ad4117 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:00.154730 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-818bf7c6-6c1b-4789-abd1-8e06a0ad4117 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:00.161087 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-818bf7c6-6c1b-4789-abd1-8e06a0ad4117 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:00.161564 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-818bf7c6-6c1b-4789-abd1-8e06a0ad4117 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:00.161996 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-818bf7c6-6c1b-4789-abd1-8e06a0ad4117 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:00.162678 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-818bf7c6-6c1b-4789-abd1-8e06a0ad4117 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:00.163155 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-818bf7c6-6c1b-4789-abd1-8e06a0ad4117 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:00.163579 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-818bf7c6-6c1b-4789-abd1-8e06a0ad4117 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:00.303949 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-818bf7c6-6c1b-4789-abd1-8e06a0ad4117 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:00.311980 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-818bf7c6-6c1b-4789-abd1-8e06a0ad4117 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1757 microversion: 2.1 time: 0.161727 Aug 30 05:21:00.312562 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 493/1018] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:00 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:01.332851 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-2eff2cb4-af79-4933-be63-5bc8f06f96d1 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:01.333474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-2eff2cb4-af79-4933-be63-5bc8f06f96d1 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:01.339770 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2eff2cb4-af79-4933-be63-5bc8f06f96d1 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:01.340257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2eff2cb4-af79-4933-be63-5bc8f06f96d1 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:01.340699 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2eff2cb4-af79-4933-be63-5bc8f06f96d1 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:01.341391 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2eff2cb4-af79-4933-be63-5bc8f06f96d1 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:01.341848 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2eff2cb4-af79-4933-be63-5bc8f06f96d1 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:01.342274 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-2eff2cb4-af79-4933-be63-5bc8f06f96d1 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:01.483023 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-2eff2cb4-af79-4933-be63-5bc8f06f96d1 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:01.491131 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-2eff2cb4-af79-4933-be63-5bc8f06f96d1 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1757 microversion: 2.1 time: 0.162318 Aug 30 05:21:01.491697 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 526/1019] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:01 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:02.511695 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-8a5c74c3-8424-4f9e-b026-30bff6e8fdfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:02.512310 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-8a5c74c3-8424-4f9e-b026-30bff6e8fdfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:02.518560 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a5c74c3-8424-4f9e-b026-30bff6e8fdfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:02.519079 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a5c74c3-8424-4f9e-b026-30bff6e8fdfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:02.519635 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a5c74c3-8424-4f9e-b026-30bff6e8fdfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:02.520181 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a5c74c3-8424-4f9e-b026-30bff6e8fdfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:02.520637 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a5c74c3-8424-4f9e-b026-30bff6e8fdfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:02.521056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-8a5c74c3-8424-4f9e-b026-30bff6e8fdfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:02.665154 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-8a5c74c3-8424-4f9e-b026-30bff6e8fdfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:02.674019 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-8a5c74c3-8424-4f9e-b026-30bff6e8fdfa tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1757 microversion: 2.1 time: 0.166090 Aug 30 05:21:02.674511 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 494/1020] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:02 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:03.694929 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-fae8e565-2094-4f64-97e3-86c8b4d0baa7 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:03.695541 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-fae8e565-2094-4f64-97e3-86c8b4d0baa7 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:03.701825 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fae8e565-2094-4f64-97e3-86c8b4d0baa7 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:03.702309 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fae8e565-2094-4f64-97e3-86c8b4d0baa7 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:03.702743 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fae8e565-2094-4f64-97e3-86c8b4d0baa7 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:03.703444 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fae8e565-2094-4f64-97e3-86c8b4d0baa7 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:03.703892 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fae8e565-2094-4f64-97e3-86c8b4d0baa7 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:03.704313 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-fae8e565-2094-4f64-97e3-86c8b4d0baa7 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:03.849621 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-fae8e565-2094-4f64-97e3-86c8b4d0baa7 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:03.857723 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-fae8e565-2094-4f64-97e3-86c8b4d0baa7 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1757 microversion: 2.1 time: 0.166714 Aug 30 05:21:03.858291 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 527/1021] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:03 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:04.878900 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-aaa19ade-e6bd-43b8-ae66-36a57ffffbf6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:04.879550 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-aaa19ade-e6bd-43b8-ae66-36a57ffffbf6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:04.885931 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaa19ade-e6bd-43b8-ae66-36a57ffffbf6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:04.886409 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaa19ade-e6bd-43b8-ae66-36a57ffffbf6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:04.886869 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaa19ade-e6bd-43b8-ae66-36a57ffffbf6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:04.887556 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaa19ade-e6bd-43b8-ae66-36a57ffffbf6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:04.888011 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaa19ade-e6bd-43b8-ae66-36a57ffffbf6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:04.888429 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-aaa19ade-e6bd-43b8-ae66-36a57ffffbf6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:05.026425 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-aaa19ade-e6bd-43b8-ae66-36a57ffffbf6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:05.035075 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-aaa19ade-e6bd-43b8-ae66-36a57ffffbf6 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1757 microversion: 2.1 time: 0.160003 Aug 30 05:21:05.035647 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 495/1022] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:04 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:06.057378 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f860d8f6-ea42-4202-8dc6-6db6d1541655 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:06.057978 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f860d8f6-ea42-4202-8dc6-6db6d1541655 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:06.064309 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f860d8f6-ea42-4202-8dc6-6db6d1541655 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:06.064788 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f860d8f6-ea42-4202-8dc6-6db6d1541655 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:06.065218 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f860d8f6-ea42-4202-8dc6-6db6d1541655 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:06.065900 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f860d8f6-ea42-4202-8dc6-6db6d1541655 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:06.066348 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f860d8f6-ea42-4202-8dc6-6db6d1541655 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:06.066767 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f860d8f6-ea42-4202-8dc6-6db6d1541655 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:06.203016 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f860d8f6-ea42-4202-8dc6-6db6d1541655 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:06.211508 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f860d8f6-ea42-4202-8dc6-6db6d1541655 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1757 microversion: 2.1 time: 0.157965 Aug 30 05:21:06.212069 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 528/1023] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:06 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:07.233285 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6998fa23-27f3-4b68-b3b1-fc6879fd9e0e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:07.233905 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6998fa23-27f3-4b68-b3b1-fc6879fd9e0e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:07.240997 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6998fa23-27f3-4b68-b3b1-fc6879fd9e0e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:07.241484 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6998fa23-27f3-4b68-b3b1-fc6879fd9e0e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:07.241923 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6998fa23-27f3-4b68-b3b1-fc6879fd9e0e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:07.242615 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6998fa23-27f3-4b68-b3b1-fc6879fd9e0e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:07.243132 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6998fa23-27f3-4b68-b3b1-fc6879fd9e0e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:07.243556 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6998fa23-27f3-4b68-b3b1-fc6879fd9e0e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:07.384646 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6998fa23-27f3-4b68-b3b1-fc6879fd9e0e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:07.393312 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6998fa23-27f3-4b68-b3b1-fc6879fd9e0e tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1757 microversion: 2.1 time: 0.164098 Aug 30 05:21:07.393879 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 496/1024] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:07 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:08.413470 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e783d793-d5b6-4e15-8fd9-a685c5251551 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:08.414085 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e783d793-d5b6-4e15-8fd9-a685c5251551 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:08.420559 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e783d793-d5b6-4e15-8fd9-a685c5251551 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:08.421044 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e783d793-d5b6-4e15-8fd9-a685c5251551 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:08.421482 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e783d793-d5b6-4e15-8fd9-a685c5251551 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:08.422172 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e783d793-d5b6-4e15-8fd9-a685c5251551 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:08.422627 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e783d793-d5b6-4e15-8fd9-a685c5251551 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:08.423095 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e783d793-d5b6-4e15-8fd9-a685c5251551 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:08.568101 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e783d793-d5b6-4e15-8fd9-a685c5251551 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:08.576215 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e783d793-d5b6-4e15-8fd9-a685c5251551 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1757 microversion: 2.1 time: 0.166633 Aug 30 05:21:08.576778 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 529/1025] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:08 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:09.597909 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-679322b0-3fa5-45b9-a76e-b6cdf674c933 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:09.598517 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-679322b0-3fa5-45b9-a76e-b6cdf674c933 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:09.604840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-679322b0-3fa5-45b9-a76e-b6cdf674c933 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:09.605328 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-679322b0-3fa5-45b9-a76e-b6cdf674c933 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:09.605761 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-679322b0-3fa5-45b9-a76e-b6cdf674c933 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:09.606447 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-679322b0-3fa5-45b9-a76e-b6cdf674c933 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:09.606924 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-679322b0-3fa5-45b9-a76e-b6cdf674c933 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:09.607347 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-679322b0-3fa5-45b9-a76e-b6cdf674c933 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:09.611303 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:09.747305 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-679322b0-3fa5-45b9-a76e-b6cdf674c933 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:09.756090 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-679322b0-3fa5-45b9-a76e-b6cdf674c933 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1760 microversion: 2.1 time: 0.162069 Aug 30 05:21:09.756663 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 497/1026] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:09 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1760 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:33.667646 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cb629ce2-ca93-4815-9a57-c9f385a7d900 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:33.668256 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cb629ce2-ca93-4815-9a57-c9f385a7d900 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:33.670248 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=19 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:33.670922 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:33.677515 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb629ce2-ca93-4815-9a57-c9f385a7d900 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:33.677996 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb629ce2-ca93-4815-9a57-c9f385a7d900 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:33.678426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb629ce2-ca93-4815-9a57-c9f385a7d900 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:33.679141 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb629ce2-ca93-4815-9a57-c9f385a7d900 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:33.679594 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb629ce2-ca93-4815-9a57-c9f385a7d900 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:33.680014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cb629ce2-ca93-4815-9a57-c9f385a7d900 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:33.704386 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cb629ce2-ca93-4815-9a57-c9f385a7d900 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070/ips" status: 200 len: 149 microversion: 2.1 time: 0.041105 Aug 30 05:21:33.704979 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 530/1027] 10.222.0.77 () {58 vars in 1248 bytes} [Tue Aug 30 05:21:33 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:21:35.023657 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1216130a-718f-4ff8-8458-1f132209f9b4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c08ece2-288c-4b5e-a875-f2990b2653aa"}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:35.026084 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1216130a-718f-4ff8-8458-1f132209f9b4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:35.028262 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=19 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:35.029099 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=5 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:35.034940 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1216130a-718f-4ff8-8458-1f132209f9b4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:35.035438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1216130a-718f-4ff8-8458-1f132209f9b4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:35.035878 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1216130a-718f-4ff8-8458-1f132209f9b4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:35.036598 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1216130a-718f-4ff8-8458-1f132209f9b4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:35.037074 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1216130a-718f-4ff8-8458-1f132209f9b4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:35.037718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1216130a-718f-4ff8-8458-1f132209f9b4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:35.289736 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1216130a-718f-4ff8-8458-1f132209f9b4 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "POST /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269953 Aug 30 05:21:35.290345 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 498/1028] 10.222.0.77 () {60 vars in 1323 bytes} [Tue Aug 30 05:21:35 2022] POST /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:21:42.802114 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-48f07311-f403-416b-a3f6-ba875e36eec7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c08ece2-288c-4b5e-a875-f2990b2653aa"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:42.804575 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-48f07311-f403-416b-a3f6-ba875e36eec7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:42.811052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48f07311-f403-416b-a3f6-ba875e36eec7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:42.811519 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48f07311-f403-416b-a3f6-ba875e36eec7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:42.811955 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48f07311-f403-416b-a3f6-ba875e36eec7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:42.812641 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48f07311-f403-416b-a3f6-ba875e36eec7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:42.813096 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48f07311-f403-416b-a3f6-ba875e36eec7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:42.813522 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-48f07311-f403-416b-a3f6-ba875e36eec7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:42.890853 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-48f07311-f403-416b-a3f6-ba875e36eec7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] HTTP exception thrown: Invalid volume: volume 2c08ece2-288c-4b5e-a875-f2990b2653aa is already attached to instances: 609ae0b0-7ae0-4849-b6c0-47a80959c070 Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-48f07311-f403-416b-a3f6-ba875e36eec7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Request method failure captured: Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: POST /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070/os-volume_attachments HTTP/1.1 Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 74 Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZ1_BwqBAvo25XUAt_hPX0zVighjm0QlniWU-jqAI4fG3e31IXufsUyXytncyQcNIsqbFJosPnnVGxtyzcvHCLdS0OGpuhx6w1qakeVZUvmKyNmZ6a2aA0JwLTrTvk1kHTprNY5RT9dfrhFGUO0IJBcYTYeHf_BQhuD-oVr-rD2jMpc Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:21:42.892598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:21:42.894246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bebd859c24cd4ed3b7e32a82de820b8a", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:21:42.894246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:21:42.894246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:21:42.894246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:21:42.894246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:21:42.894246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:21:42.894246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:21:42.894246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: d079e0264f0e40db9fc93b8f217a7a74 Aug 30 05:21:42.894246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:21:42.894246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Aug 30 05:21:42.894246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {"volumeAttachment": {"volumeId": "2c08ece2-288c-4b5e-a875-f2990b2653aa"}} Aug 30 05:21:42.894246 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Invalid volume: volume 2c08ece2-288c-4b5e-a875-f2990b2653aa is already attached to instances: 609ae0b0-7ae0-4849-b6c0-47a80959c070 Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'server_id': '609ae0b0-7ae0-4849-b6c0-47a80959c070', 'body': {'volumeAttachment': {'volumeId': '2c08ece2-288c-4b5e-a875-f2990b2653aa'}}} Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2c08ece2-288c-4b5e-a875-f2990b2653aa is already attached to instances: 609ae0b0-7ae0-4849-b6c0-47a80959c070 Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:21:42.895222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2c08ece2-288c-4b5e-a875-f2990b2653aa is already attached to instances: 609ae0b0-7ae0-4849-b6c0-47a80959c070 Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:42.896709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:21:42.898288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:21:42.898288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:21:42.898288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:21:42.898288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2c08ece2-288c-4b5e-a875-f2990b2653aa is already attached to instances: 609ae0b0-7ae0-4849-b6c0-47a80959c070 Aug 30 05:21:42.898288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:21:42.898288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-48f07311-f403-416b-a3f6-ba875e36eec7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Returning 400 to user: Invalid volume: volume 2c08ece2-288c-4b5e-a875-f2990b2653aa is already attached to instances: 609ae0b0-7ae0-4849-b6c0-47a80959c070 {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:21:42.898288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-48f07311-f403-416b-a3f6-ba875e36eec7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "POST /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096442 Aug 30 05:21:42.898288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 531/1029] 10.222.0.77 () {60 vars in 1323 bytes} [Tue Aug 30 05:21:42 2022] POST /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 05:21:42.957557 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ecf5c297-49e5-45c3-82ff-584df655940e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:42.958133 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ecf5c297-49e5-45c3-82ff-584df655940e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:42.964449 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecf5c297-49e5-45c3-82ff-584df655940e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:42.964928 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecf5c297-49e5-45c3-82ff-584df655940e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:42.965360 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecf5c297-49e5-45c3-82ff-584df655940e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:42.966045 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecf5c297-49e5-45c3-82ff-584df655940e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:42.966495 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecf5c297-49e5-45c3-82ff-584df655940e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:42.966952 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecf5c297-49e5-45c3-82ff-584df655940e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:43.045823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-ecf5c297-49e5-45c3-82ff-584df655940e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lazy-loading 'services' on Instance uuid 609ae0b0-7ae0-4849-b6c0-47a80959c070 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:21:43.117075 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ecf5c297-49e5-45c3-82ff-584df655940e tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "DELETE /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070/os-volume_attachments/2c08ece2-288c-4b5e-a875-f2990b2653aa" status: 202 len: 0 microversion: 2.1 time: 0.164153 Aug 30 05:21:43.117652 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 499/1030] 10.222.0.77 () {58 vars in 1416 bytes} [Tue Aug 30 05:21:42 2022] DELETE /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070/os-volume_attachments/2c08ece2-288c-4b5e-a875-f2990b2653aa => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:21:43.125987 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-40a4f3e8-1404-461a-b69c-827f79528513 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:43.128914 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-40a4f3e8-1404-461a-b69c-827f79528513 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:43.136240 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40a4f3e8-1404-461a-b69c-827f79528513 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:43.136844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40a4f3e8-1404-461a-b69c-827f79528513 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:43.137640 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40a4f3e8-1404-461a-b69c-827f79528513 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:43.138480 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40a4f3e8-1404-461a-b69c-827f79528513 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:43.138913 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40a4f3e8-1404-461a-b69c-827f79528513 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:43.139264 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-40a4f3e8-1404-461a-b69c-827f79528513 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:43.169375 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-40a4f3e8-1404-461a-b69c-827f79528513 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047278 Aug 30 05:21:43.169936 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 532/1031] 10.222.0.77 () {58 vars in 1302 bytes} [Tue Aug 30 05:21:43 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:21:44.182655 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-fae23628-09f7-4b59-bfd9-e2ac621a9ac0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:44.185023 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-fae23628-09f7-4b59-bfd9-e2ac621a9ac0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:44.191373 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fae23628-09f7-4b59-bfd9-e2ac621a9ac0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:44.191925 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fae23628-09f7-4b59-bfd9-e2ac621a9ac0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:44.192365 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fae23628-09f7-4b59-bfd9-e2ac621a9ac0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:44.193108 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fae23628-09f7-4b59-bfd9-e2ac621a9ac0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:44.193570 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fae23628-09f7-4b59-bfd9-e2ac621a9ac0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:44.193998 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-fae23628-09f7-4b59-bfd9-e2ac621a9ac0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:44.225481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-fae23628-09f7-4b59-bfd9-e2ac621a9ac0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047610 Aug 30 05:21:44.226037 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 500/1032] 10.222.0.77 () {58 vars in 1302 bytes} [Tue Aug 30 05:21:44 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 05:21:44.285132 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-665310ae-f7c6-4a8d-a8df-4001c9c20f8d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:44.285634 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-665310ae-f7c6-4a8d-a8df-4001c9c20f8d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:44.292042 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-665310ae-f7c6-4a8d-a8df-4001c9c20f8d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:44.292515 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-665310ae-f7c6-4a8d-a8df-4001c9c20f8d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:44.292946 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-665310ae-f7c6-4a8d-a8df-4001c9c20f8d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:44.293622 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-665310ae-f7c6-4a8d-a8df-4001c9c20f8d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:44.294106 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-665310ae-f7c6-4a8d-a8df-4001c9c20f8d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:44.294529 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-665310ae-f7c6-4a8d-a8df-4001c9c20f8d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:44.320563 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-665310ae-f7c6-4a8d-a8df-4001c9c20f8d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:21:44.393861 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-665310ae-f7c6-4a8d-a8df-4001c9c20f8d tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "DELETE /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 204 len: 0 microversion: 2.1 time: 0.112776 Aug 30 05:21:44.394445 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 533/1033] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:21:44 2022] DELETE /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:21:44.402425 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2ffedddd-9e52-41a0-936f-b51bd97cbc71 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:44.403071 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2ffedddd-9e52-41a0-936f-b51bd97cbc71 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:44.410510 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ffedddd-9e52-41a0-936f-b51bd97cbc71 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:44.411027 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ffedddd-9e52-41a0-936f-b51bd97cbc71 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:44.411469 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ffedddd-9e52-41a0-936f-b51bd97cbc71 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:44.412171 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ffedddd-9e52-41a0-936f-b51bd97cbc71 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:44.412630 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ffedddd-9e52-41a0-936f-b51bd97cbc71 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:44.413059 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2ffedddd-9e52-41a0-936f-b51bd97cbc71 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:44.542065 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-2ffedddd-9e52-41a0-936f-b51bd97cbc71 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:44.549799 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2ffedddd-9e52-41a0-936f-b51bd97cbc71 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 200 len: 1680 microversion: 2.1 time: 0.151150 Aug 30 05:21:44.550372 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 501/1034] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:44 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:21:45.110392 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6a4deb45-8ceb-4ea5-9b8e-321582111620 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1231379107"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:45.111537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6a4deb45-8ceb-4ea5-9b8e-321582111620 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:45.117392 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a4deb45-8ceb-4ea5-9b8e-321582111620 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:45.117876 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a4deb45-8ceb-4ea5-9b8e-321582111620 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:45.118316 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a4deb45-8ceb-4ea5-9b8e-321582111620 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:45.119033 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a4deb45-8ceb-4ea5-9b8e-321582111620 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:45.119489 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a4deb45-8ceb-4ea5-9b8e-321582111620 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:45.119919 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6a4deb45-8ceb-4ea5-9b8e-321582111620 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:45.247581 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.network.security_group_api [None req-6a4deb45-8ceb-4ea5-9b8e-321582111620 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Removing security group dbefcf5d-96fc-483e-9b27-47e5117d2b90 from port 71a60ab2-f1e6-480a-89ba-78b963887538 Aug 30 05:21:45.552275 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6a4deb45-8ceb-4ea5-9b8e-321582111620 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "POST /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/action" status: 202 len: 0 microversion: 2.1 time: 0.445936 Aug 30 05:21:45.556127 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 534/1035] 10.222.0.77 () {60 vars in 1278 bytes} [Tue Aug 30 05:21:45 2022] POST /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:21:45.559717 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-1401311d-5464-4826-b38b-570c388fa807 req-fe36f996-7918-47bc-bd5c-7043c7c6dc55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "565b3109-ab27-4465-aa1c-b4002d4e9792", "tag": "71a60ab2-f1e6-480a-89ba-78b963887538"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:45.570926 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-1401311d-5464-4826-b38b-570c388fa807 req-fe36f996-7918-47bc-bd5c-7043c7c6dc55 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:45.571541 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-1401311d-5464-4826-b38b-570c388fa807 req-fe36f996-7918-47bc-bd5c-7043c7c6dc55 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:45.572261 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-1401311d-5464-4826-b38b-570c388fa807 req-fe36f996-7918-47bc-bd5c-7043c7c6dc55 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:45.573193 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-399d5efb-9c78-48d0-919c-447f79222ba0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:45.573986 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-399d5efb-9c78-48d0-919c-447f79222ba0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:45.582579 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-399d5efb-9c78-48d0-919c-447f79222ba0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:45.583462 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-399d5efb-9c78-48d0-919c-447f79222ba0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:45.584110 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-399d5efb-9c78-48d0-919c-447f79222ba0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:45.585186 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-399d5efb-9c78-48d0-919c-447f79222ba0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:45.585813 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-399d5efb-9c78-48d0-919c-447f79222ba0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:45.586568 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-399d5efb-9c78-48d0-919c-447f79222ba0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:45.591384 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-1401311d-5464-4826-b38b-570c388fa807 req-fe36f996-7918-47bc-bd5c-7043c7c6dc55 service nova] Creating event network-changed:71a60ab2-f1e6-480a-89ba-78b963887538 for instance 565b3109-ab27-4465-aa1c-b4002d4e9792 on hv-cinder-85391 Aug 30 05:21:45.597698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-1401311d-5464-4826-b38b-570c388fa807 req-fe36f996-7918-47bc-bd5c-7043c7c6dc55 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042082 Aug 30 05:21:45.599589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 502/1036] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:21:45.809886 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-399d5efb-9c78-48d0-919c-447f79222ba0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:45.819512 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-399d5efb-9c78-48d0-919c-447f79222ba0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 200 len: 1680 microversion: 2.1 time: 0.250577 Aug 30 05:21:45.831273 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 535/1037] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:45 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 1680 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:46.844309 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-35d8e237-8a4f-4b51-8cfb-f0aae08ba3ab tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:46.846164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-35d8e237-8a4f-4b51-8cfb-f0aae08ba3ab tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:46.852224 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35d8e237-8a4f-4b51-8cfb-f0aae08ba3ab tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:46.852720 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35d8e237-8a4f-4b51-8cfb-f0aae08ba3ab tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:46.853165 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35d8e237-8a4f-4b51-8cfb-f0aae08ba3ab tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:46.853872 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35d8e237-8a4f-4b51-8cfb-f0aae08ba3ab tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:46.854338 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35d8e237-8a4f-4b51-8cfb-f0aae08ba3ab tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:46.854768 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-35d8e237-8a4f-4b51-8cfb-f0aae08ba3ab tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:46.990635 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-35d8e237-8a4f-4b51-8cfb-f0aae08ba3ab tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:46.998542 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-35d8e237-8a4f-4b51-8cfb-f0aae08ba3ab tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 200 len: 1680 microversion: 2.1 time: 0.158992 Aug 30 05:21:46.999357 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 503/1038] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:46 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:47.417702 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-7eed0959-8150-4cf2-a935-894cf2765175 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:47.418239 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-7eed0959-8150-4cf2-a935-894cf2765175 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:47.424525 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eed0959-8150-4cf2-a935-894cf2765175 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:47.425010 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eed0959-8150-4cf2-a935-894cf2765175 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:47.425448 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eed0959-8150-4cf2-a935-894cf2765175 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:47.426149 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eed0959-8150-4cf2-a935-894cf2765175 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:47.426603 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eed0959-8150-4cf2-a935-894cf2765175 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:47.427055 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-7eed0959-8150-4cf2-a935-894cf2765175 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:47.515893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-7eed0959-8150-4cf2-a935-894cf2765175 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lazy-loading 'services' on Instance uuid 565b3109-ab27-4465-aa1c-b4002d4e9792 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:21:47.596548 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-7eed0959-8150-4cf2-a935-894cf2765175 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "DELETE /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/os-volume_attachments/a203d5a9-8617-4d0b-b0a1-61ac833e029d" status: 202 len: 0 microversion: 2.1 time: 0.182598 Aug 30 05:21:47.597426 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 536/1039] 10.222.0.77 () {58 vars in 1416 bytes} [Tue Aug 30 05:21:47 2022] DELETE /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/os-volume_attachments/a203d5a9-8617-4d0b-b0a1-61ac833e029d => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:21:47.605948 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2fe6c321-7ba4-4046-98a3-77d965dbd44a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:47.608900 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2fe6c321-7ba4-4046-98a3-77d965dbd44a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:47.615661 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fe6c321-7ba4-4046-98a3-77d965dbd44a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:47.616160 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fe6c321-7ba4-4046-98a3-77d965dbd44a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:47.616656 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fe6c321-7ba4-4046-98a3-77d965dbd44a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:47.617369 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fe6c321-7ba4-4046-98a3-77d965dbd44a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:47.617994 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fe6c321-7ba4-4046-98a3-77d965dbd44a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:47.618581 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2fe6c321-7ba4-4046-98a3-77d965dbd44a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:47.634595 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-cfea7995-b589-49ff-ba59-bcee836a2cf3 req-bc6fa177-74cc-47f8-820a-3795fc648b91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "565b3109-ab27-4465-aa1c-b4002d4e9792", "tag": "71a60ab2-f1e6-480a-89ba-78b963887538"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:47.653119 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-cfea7995-b589-49ff-ba59-bcee836a2cf3 req-bc6fa177-74cc-47f8-820a-3795fc648b91 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:47.653811 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-cfea7995-b589-49ff-ba59-bcee836a2cf3 req-bc6fa177-74cc-47f8-820a-3795fc648b91 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:47.654315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-cfea7995-b589-49ff-ba59-bcee836a2cf3 req-bc6fa177-74cc-47f8-820a-3795fc648b91 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:47.679985 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-cfea7995-b589-49ff-ba59-bcee836a2cf3 req-bc6fa177-74cc-47f8-820a-3795fc648b91 service nova] Creating event network-changed:71a60ab2-f1e6-480a-89ba-78b963887538 for instance 565b3109-ab27-4465-aa1c-b4002d4e9792 on hv-cinder-85391 Aug 30 05:21:47.688178 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2fe6c321-7ba4-4046-98a3-77d965dbd44a tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086218 Aug 30 05:21:47.688709 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-cfea7995-b589-49ff-ba59-bcee836a2cf3 req-bc6fa177-74cc-47f8-820a-3795fc648b91 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058379 Aug 30 05:21:47.690049 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 504/1040] 10.222.0.77 () {58 vars in 1302 bytes} [Tue Aug 30 05:21:47 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:21:47.691085 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 537/1041] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:21:48.019902 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f3b00c96-7cee-4591-9fea-7bc8ed31f7cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:48.020618 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f3b00c96-7cee-4591-9fea-7bc8ed31f7cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:48.027243 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3b00c96-7cee-4591-9fea-7bc8ed31f7cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:48.027807 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3b00c96-7cee-4591-9fea-7bc8ed31f7cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:48.028438 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3b00c96-7cee-4591-9fea-7bc8ed31f7cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:48.029149 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3b00c96-7cee-4591-9fea-7bc8ed31f7cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:48.029612 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3b00c96-7cee-4591-9fea-7bc8ed31f7cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:48.030042 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3b00c96-7cee-4591-9fea-7bc8ed31f7cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:48.065183 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3b00c96-7cee-4591-9fea-7bc8ed31f7cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:48.069330 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3b00c96-7cee-4591-9fea-7bc8ed31f7cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:48.069840 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f3b00c96-7cee-4591-9fea-7bc8ed31f7cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:48.070541 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-f3b00c96-7cee-4591-9fea-7bc8ed31f7cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lazy-loading 'fault' on Instance uuid 609ae0b0-7ae0-4849-b6c0-47a80959c070 {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:21:48.128201 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f3b00c96-7cee-4591-9fea-7bc8ed31f7cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:48.144239 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f3b00c96-7cee-4591-9fea-7bc8ed31f7cc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 200 len: 1330 microversion: 2.1 time: 0.128348 Aug 30 05:21:48.147587 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 505/1042] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:48 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 1330 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:48.703214 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-de9ec183-5116-493c-b74e-601bae21d202 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:48.706281 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-de9ec183-5116-493c-b74e-601bae21d202 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:48.718060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de9ec183-5116-493c-b74e-601bae21d202 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:48.718600 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de9ec183-5116-493c-b74e-601bae21d202 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:48.719092 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de9ec183-5116-493c-b74e-601bae21d202 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:48.719959 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de9ec183-5116-493c-b74e-601bae21d202 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:48.721014 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de9ec183-5116-493c-b74e-601bae21d202 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:48.721626 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-de9ec183-5116-493c-b74e-601bae21d202 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:48.754512 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-de9ec183-5116-493c-b74e-601bae21d202 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056357 Aug 30 05:21:48.755467 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 538/1043] 10.222.0.77 () {58 vars in 1302 bytes} [Tue Aug 30 05:21:48 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 05:21:48.766378 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2082c05b-986c-4f8b-963e-8b0ee12fba91 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:48.766948 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2082c05b-986c-4f8b-963e-8b0ee12fba91 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:48.773104 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2082c05b-986c-4f8b-963e-8b0ee12fba91 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:48.774758 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2082c05b-986c-4f8b-963e-8b0ee12fba91 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:48.775264 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2082c05b-986c-4f8b-963e-8b0ee12fba91 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:48.775997 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2082c05b-986c-4f8b-963e-8b0ee12fba91 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:48.776470 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2082c05b-986c-4f8b-963e-8b0ee12fba91 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:48.777084 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2082c05b-986c-4f8b-963e-8b0ee12fba91 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:48.867906 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-2082c05b-986c-4f8b-963e-8b0ee12fba91 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] HTTP exception thrown: Instance 565b3109-ab27-4465-aa1c-b4002d4e9792 is not attached to volume a203d5a9-8617-4d0b-b0a1-61ac833e029d Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2082c05b-986c-4f8b-963e-8b0ee12fba91 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Request method failure captured: Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/os-volume_attachments/a203d5a9-8617-4d0b-b0a1-61ac833e029d HTTP/1.1 Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZ3mYhO9gXWnMA-VAPkX6NOrl63fDAZW0-UTI6ABgA57ZMuFvdF34LJJT2RIk5zz7hwg1llTjvTlGLtaTzJTuCzCdCl7AP_UiEGgAE__6Nh-bQzI8H0bOE1v9WQYOIwh0xKs9NODpK-3GfSvP2lZhgoexOoRylPUHAzQLHpdJnZkyZ0 Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: 4826d4507ffc4e3288aac00b1409ea46 Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-TestMinimumBasicScenario-1648859406 Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:21:48.870334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:21:48.871823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/4826d4507ffc4e3288aac00b1409ea46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/4826d4507ffc4e3288aac00b1409ea46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/4826d4507ffc4e3288aac00b1409ea46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_4826d4507ffc4e3288aac00b1409ea46", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:21:48.871823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-TestMinimumBasicScenario-1648859406 Aug 30 05:21:48.871823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 4826d4507ffc4e3288aac00b1409ea46 Aug 30 05:21:48.871823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1648859406 Aug 30 05:21:48.871823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-TestMinimumBasicScenario-1648859406-project Aug 30 05:21:48.871823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:21:48.871823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:21:48.871823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: b92e3e3eff1e40d38fdfc68e467367f7 Aug 30 05:21:48.871823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-TestMinimumBasicScenario-1648859406-project Aug 30 05:21:48.871823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:21:48.871823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance 565b3109-ab27-4465-aa1c-b4002d4e9792 is not attached to volume a203d5a9-8617-4d0b-b0a1-61ac833e029d Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'server_id': '565b3109-ab27-4465-aa1c-b4002d4e9792', 'id': 'a203d5a9-8617-4d0b-b0a1-61ac833e029d'} Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a203d5a9-8617-4d0b-b0a1-61ac833e029d. Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:21:48.872590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:21:48.873847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:21:48.873847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 05:21:48.873847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 05:21:48.873847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 565b3109-ab27-4465-aa1c-b4002d4e9792 is not attached to volume a203d5a9-8617-4d0b-b0a1-61ac833e029d Aug 30 05:21:48.873847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:21:48.873847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:21:48.873847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:21:48.873847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:48.873847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:21:48.873847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:21:48.873847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:21:48.873847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:21:48.873847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 565b3109-ab27-4465-aa1c-b4002d4e9792 is not attached to volume a203d5a9-8617-4d0b-b0a1-61ac833e029d Aug 30 05:21:48.873847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:21:48.873847 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2082c05b-986c-4f8b-963e-8b0ee12fba91 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Returning 404 to user: Instance 565b3109-ab27-4465-aa1c-b4002d4e9792 is not attached to volume a203d5a9-8617-4d0b-b0a1-61ac833e029d {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:21:48.878492 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2082c05b-986c-4f8b-963e-8b0ee12fba91 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "DELETE /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/os-volume_attachments/a203d5a9-8617-4d0b-b0a1-61ac833e029d" status: 404 len: 154 microversion: 2.1 time: 0.109854 Aug 30 05:21:48.878492 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 506/1044] 10.222.0.77 () {58 vars in 1416 bytes} [Tue Aug 30 05:21:48 2022] DELETE /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792/os-volume_attachments/a203d5a9-8617-4d0b-b0a1-61ac833e029d => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:21:49.167498 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c960e73f-c341-4acd-ab91-953ddea96adb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:49.168022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c960e73f-c341-4acd-ab91-953ddea96adb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:49.175068 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c960e73f-c341-4acd-ab91-953ddea96adb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:49.175625 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c960e73f-c341-4acd-ab91-953ddea96adb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:49.176406 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c960e73f-c341-4acd-ab91-953ddea96adb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:49.177063 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c960e73f-c341-4acd-ab91-953ddea96adb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:49.177518 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c960e73f-c341-4acd-ab91-953ddea96adb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:49.177947 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c960e73f-c341-4acd-ab91-953ddea96adb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:49.191456 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-c960e73f-c341-4acd-ab91-953ddea96adb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] HTTP exception thrown: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c960e73f-c341-4acd-ab91-953ddea96adb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Request method failure captured: Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 HTTP/1.1 Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZ1_BwqBAvo25XUAt_hPX0zVighjm0QlniWU-jqAI4fG3e31IXufsUyXytncyQcNIsqbFJosPnnVGxtyzcvHCLdS0OGpuhx6w1qakeVZUvmKyNmZ6a2aA0JwLTrTvk1kHTprNY5RT9dfrhFGUO0IJBcYTYeHf_BQhuD-oVr-rD2jMpc Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:21:49.193257 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:21:49.194905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bebd859c24cd4ed3b7e32a82de820b8a", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:21:49.194905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:21:49.194905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:21:49.194905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:21:49.194905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:21:49.194905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:21:49.194905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:21:49.194905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: d079e0264f0e40db9fc93b8f217a7a74 Aug 30 05:21:49.194905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:21:49.194905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:21:49.194905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. Aug 30 05:21:49.194905 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '609ae0b0-7ae0-4849-b6c0-47a80959c070'} Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:21:49.195906 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. Aug 30 05:21:49.197317 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:21:49.198560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c960e73f-c341-4acd-ab91-953ddea96adb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Returning 404 to user: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:21:49.198560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c960e73f-c341-4acd-ab91-953ddea96adb tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 404 len: 111 microversion: 2.1 time: 0.031327 Aug 30 05:21:49.198560 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 539/1045] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:49 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:21:49.205496 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2ad132af-85fb-42f5-a31b-7f7335f97347 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '.version_select at 0x7f822ec2ad30>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:49.226784 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2ad132af-85fb-42f5-a31b-7f7335f97347 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-519516746" status: 202 len: 0 microversion: 2.1 time: 0.025294 Aug 30 05:21:49.227356 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 507/1046] 10.222.0.77 () {58 vars in 1218 bytes} [Tue Aug 30 05:21:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-519516746 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:21:49.704313 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-deb10bfe-f3f5-449e-b641-246288edcc5e req-9c8bcd55-f8c8-4963-8f1e-be25ca9fcce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "609ae0b0-7ae0-4849-b6c0-47a80959c070", "name": "network-vif-deleted", "tag": "a1156e08-a434-4102-a3ae-9e9dc323ddf6"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:49.714730 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-deb10bfe-f3f5-449e-b641-246288edcc5e req-9c8bcd55-f8c8-4963-8f1e-be25ca9fcce6 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:49.715168 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-deb10bfe-f3f5-449e-b641-246288edcc5e req-9c8bcd55-f8c8-4963-8f1e-be25ca9fcce6 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:49.715602 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-deb10bfe-f3f5-449e-b641-246288edcc5e req-9c8bcd55-f8c8-4963-8f1e-be25ca9fcce6 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:49.727478 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-deb10bfe-f3f5-449e-b641-246288edcc5e req-9c8bcd55-f8c8-4963-8f1e-be25ca9fcce6 service nova] Creating event network-vif-deleted:a1156e08-a434-4102-a3ae-9e9dc323ddf6 for instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 on hv-cinder-85391 Aug 30 05:21:49.732276 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-deb10bfe-f3f5-449e-b641-246288edcc5e req-9c8bcd55-f8c8-4963-8f1e-be25ca9fcce6 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031773 Aug 30 05:21:49.732868 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 540/1047] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:21:49.830930 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d1d7bb8c-74a5-4054-ac46-abab0d1ca6ae tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Action: 'create', calling method: .version_select at 0x7f822ec99040>, body: {"keypair": {"name": "tempest-keypair-1494234423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeYAIDVPf7ak9b8RZZsEMaVK1n2kytVBE4S3kKl8DRqhNFVJWPKknC5MNC/ygOD5Z9mWN93yxMRVY71lakKaybMkCxnwq/Y1Shk+a+YNN8O0JK4i7ZwVy91hOOs+TwpMQ=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:49.846157 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-d1d7bb8c-74a5-4054-ac46-abab0d1ca6ae tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Getting quotas for project bebd859c24cd4ed3b7e32a82de820b8a. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:21:49.849941 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-d1d7bb8c-74a5-4054-ac46-abab0d1ca6ae tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Getting quotas for user d079e0264f0e40db9fc93b8f217a7a74 and project bebd859c24cd4ed3b7e32a82de820b8a. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:21:49.870834 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d1d7bb8c-74a5-4054-ac46-abab0d1ca6ae tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044529 Aug 30 05:21:49.871405 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 508/1048] 10.222.0.77 () {60 vars in 1159 bytes} [Tue Aug 30 05:21:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:21:50.031804 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a56e9c8f-26a1-45a0-b1a7-cc43989cd738 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:50.032346 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a56e9c8f-26a1-45a0-b1a7-cc43989cd738 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:50.038494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a56e9c8f-26a1-45a0-b1a7-cc43989cd738 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:50.039057 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a56e9c8f-26a1-45a0-b1a7-cc43989cd738 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:50.039496 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a56e9c8f-26a1-45a0-b1a7-cc43989cd738 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:50.040385 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a56e9c8f-26a1-45a0-b1a7-cc43989cd738 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:50.040840 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a56e9c8f-26a1-45a0-b1a7-cc43989cd738 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:50.041274 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a56e9c8f-26a1-45a0-b1a7-cc43989cd738 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:50.067329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a56e9c8f-26a1-45a0-b1a7-cc43989cd738 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:21:50.151208 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a56e9c8f-26a1-45a0-b1a7-cc43989cd738 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "DELETE /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 204 len: 0 microversion: 2.1 time: 0.123057 Aug 30 05:21:50.151884 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 541/1049] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:21:50 2022] DELETE /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 05:21:50.164100 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-98d704d8-9025-43c7-b09a-fc1290a6ac29 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:50.165135 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-98d704d8-9025-43c7-b09a-fc1290a6ac29 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:50.172161 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-98d704d8-9025-43c7-b09a-fc1290a6ac29 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:50.172891 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-98d704d8-9025-43c7-b09a-fc1290a6ac29 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:50.173999 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-98d704d8-9025-43c7-b09a-fc1290a6ac29 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:50.174713 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-98d704d8-9025-43c7-b09a-fc1290a6ac29 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:50.175268 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-98d704d8-9025-43c7-b09a-fc1290a6ac29 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:50.175699 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-98d704d8-9025-43c7-b09a-fc1290a6ac29 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:50.355746 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-98d704d8-9025-43c7-b09a-fc1290a6ac29 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:50.364047 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-98d704d8-9025-43c7-b09a-fc1290a6ac29 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1555 microversion: 2.1 time: 0.205900 Aug 30 05:21:50.364630 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 509/1050] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:50 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1555 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:21:51.147797 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-968675214", "imageRef": "d3fbed44-8c63-4242-ae78-27c456f05108", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ff2f7ffd-21e7-4f75-8a8d-ab24ee6942f2"}], "security_groups": [{"name": "tempest-securitygroup--943972299"}], "key_name": "tempest-keypair-1494234423", "user_data": "}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:51.253828 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] validate_networks() for [('ff2f7ffd-21e7-4f75-8a8d-ab24ee6942f2', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:21:51.385345 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3052d46b-1496-48a5-b8d5-bcd30f8423a2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:51.386094 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3052d46b-1496-48a5-b8d5-bcd30f8423a2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:51.393506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3052d46b-1496-48a5-b8d5-bcd30f8423a2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:51.394075 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3052d46b-1496-48a5-b8d5-bcd30f8423a2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:51.394577 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3052d46b-1496-48a5-b8d5-bcd30f8423a2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:51.395503 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3052d46b-1496-48a5-b8d5-bcd30f8423a2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:51.396068 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3052d46b-1496-48a5-b8d5-bcd30f8423a2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:51.396597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3052d46b-1496-48a5-b8d5-bcd30f8423a2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:51.536291 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3052d46b-1496-48a5-b8d5-bcd30f8423a2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:51.544349 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3052d46b-1496-48a5-b8d5-bcd30f8423a2 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1555 microversion: 2.1 time: 0.162735 Aug 30 05:21:51.544937 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 510/1051] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:51 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:21:51.843865 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:21:51.844293 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:21:51.844772 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:21:51.845187 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:21:51.845601 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:21:51.854306 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:51.854791 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:51.855259 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:51.855991 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:51.856448 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:51.856873 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:51.873899 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Getting quotas for project bebd859c24cd4ed3b7e32a82de820b8a. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:21:51.878522 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Getting quotas for user d079e0264f0e40db9fc93b8f217a7a74 and project bebd859c24cd4ed3b7e32a82de820b8a. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:21:51.889369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:21:51.891780 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='d3fbed44-8c63-4242-ae78-27c456f05108',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:21:51.939543 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-84e621a4-ef1e-43cf-b42d-493c654b0f4f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.795773 Aug 30 05:21:51.940190 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 542/1052] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:21:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:21:51.951029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d5770f20-0c77-40f1-b97b-a272fe2ab6d3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:51.951644 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d5770f20-0c77-40f1-b97b-a272fe2ab6d3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:52.004266 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d5770f20-0c77-40f1-b97b-a272fe2ab6d3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:52.010990 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d5770f20-0c77-40f1-b97b-a272fe2ab6d3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 200 len: 1241 microversion: 2.1 time: 0.063901 Aug 30 05:21:52.011549 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 511/1053] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:51 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:52.565814 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a3015ad0-f158-4e89-8d26-ee91c107e925 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:52.566520 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a3015ad0-f158-4e89-8d26-ee91c107e925 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:52.574806 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3015ad0-f158-4e89-8d26-ee91c107e925 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:52.576794 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3015ad0-f158-4e89-8d26-ee91c107e925 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:52.577424 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3015ad0-f158-4e89-8d26-ee91c107e925 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:52.579043 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3015ad0-f158-4e89-8d26-ee91c107e925 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:52.579920 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3015ad0-f158-4e89-8d26-ee91c107e925 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:52.580880 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a3015ad0-f158-4e89-8d26-ee91c107e925 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:52.620720 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-6258d8e7-e165-4e67-a303-d6a0579bd1e1 req-2450b9f3-218f-4b2d-a9cb-37c4c431efe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565b3109-ab27-4465-aa1c-b4002d4e9792", "name": "network-vif-deleted", "tag": "71a60ab2-f1e6-480a-89ba-78b963887538"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:52.640132 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6258d8e7-e165-4e67-a303-d6a0579bd1e1 req-2450b9f3-218f-4b2d-a9cb-37c4c431efe4 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:52.640609 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6258d8e7-e165-4e67-a303-d6a0579bd1e1 req-2450b9f3-218f-4b2d-a9cb-37c4c431efe4 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:52.641053 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-6258d8e7-e165-4e67-a303-d6a0579bd1e1 req-2450b9f3-218f-4b2d-a9cb-37c4c431efe4 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:52.652568 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-6258d8e7-e165-4e67-a303-d6a0579bd1e1 req-2450b9f3-218f-4b2d-a9cb-37c4c431efe4 service nova] Creating event network-vif-deleted:71a60ab2-f1e6-480a-89ba-78b963887538 for instance 565b3109-ab27-4465-aa1c-b4002d4e9792 on hv-cinder-85391 Aug 30 05:21:52.658241 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-6258d8e7-e165-4e67-a303-d6a0579bd1e1 req-2450b9f3-218f-4b2d-a9cb-37c4c431efe4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041554 Aug 30 05:21:52.659181 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 512/1054] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:21:52.660211 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a3015ad0-f158-4e89-8d26-ee91c107e925 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b92e3e3eff1e40d38fdfc68e467367f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4826d4507ffc4e3288aac00b1409ea46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:52.669005 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a3015ad0-f158-4e89-8d26-ee91c107e925 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 200 len: 1513 microversion: 2.1 time: 0.107522 Aug 30 05:21:52.669776 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 543/1055] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:52 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 1513 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:53.032024 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-eefcdc32-7c50-4161-b6af-5a3f5a6fdc76 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:53.032727 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-eefcdc32-7c50-4161-b6af-5a3f5a6fdc76 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:53.039383 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eefcdc32-7c50-4161-b6af-5a3f5a6fdc76 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:53.039614 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eefcdc32-7c50-4161-b6af-5a3f5a6fdc76 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:53.040263 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eefcdc32-7c50-4161-b6af-5a3f5a6fdc76 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:53.040771 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eefcdc32-7c50-4161-b6af-5a3f5a6fdc76 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:53.041275 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eefcdc32-7c50-4161-b6af-5a3f5a6fdc76 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:53.041836 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-eefcdc32-7c50-4161-b6af-5a3f5a6fdc76 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:53.120052 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-eefcdc32-7c50-4161-b6af-5a3f5a6fdc76 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:53.129170 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-eefcdc32-7c50-4161-b6af-5a3f5a6fdc76 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 200 len: 1293 microversion: 2.1 time: 0.101366 Aug 30 05:21:53.137157 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 513/1056] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:53 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 1293 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:53.690804 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4434a0a5-c201-4ed7-81c6-99a8cebe60c0 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:53.692295 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4434a0a5-c201-4ed7-81c6-99a8cebe60c0 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] [instance: 565b3109-ab27-4465-aa1c-b4002d4e9792] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:53.699429 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4434a0a5-c201-4ed7-81c6-99a8cebe60c0 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:53.699921 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4434a0a5-c201-4ed7-81c6-99a8cebe60c0 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:53.700362 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4434a0a5-c201-4ed7-81c6-99a8cebe60c0 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:53.701073 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4434a0a5-c201-4ed7-81c6-99a8cebe60c0 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:53.701561 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4434a0a5-c201-4ed7-81c6-99a8cebe60c0 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:53.701989 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4434a0a5-c201-4ed7-81c6-99a8cebe60c0 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:53.716124 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-4434a0a5-c201-4ed7-81c6-99a8cebe60c0 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] HTTP exception thrown: Instance 565b3109-ab27-4465-aa1c-b4002d4e9792 could not be found. Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4434a0a5-c201-4ed7-81c6-99a8cebe60c0 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Request method failure captured: Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 HTTP/1.1 Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZ3mYhO9gXWnMA-VAPkX6NOrl63fDAZW0-UTI6ABgA57ZMuFvdF34LJJT2RIk5zz7hwg1llTjvTlGLtaTzJTuCzCdCl7AP_UiEGgAE__6Nh-bQzI8H0bOE1v9WQYOIwh0xKs9NODpK-3GfSvP2lZhgoexOoRylPUHAzQLHpdJnZkyZ0 Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 4826d4507ffc4e3288aac00b1409ea46 Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-TestMinimumBasicScenario-1648859406 Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:21:53.717988 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:21:53.719439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/4826d4507ffc4e3288aac00b1409ea46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/4826d4507ffc4e3288aac00b1409ea46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/4826d4507ffc4e3288aac00b1409ea46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_4826d4507ffc4e3288aac00b1409ea46", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:21:53.719439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-TestMinimumBasicScenario-1648859406 Aug 30 05:21:53.719439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 4826d4507ffc4e3288aac00b1409ea46 Aug 30 05:21:53.719439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1648859406 Aug 30 05:21:53.719439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-TestMinimumBasicScenario-1648859406-project Aug 30 05:21:53.719439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:21:53.719439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:21:53.719439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: b92e3e3eff1e40d38fdfc68e467367f7 Aug 30 05:21:53.719439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-TestMinimumBasicScenario-1648859406-project Aug 30 05:21:53.719439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:21:53.719439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 565b3109-ab27-4465-aa1c-b4002d4e9792 could not be found. Aug 30 05:21:53.719439 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '565b3109-ab27-4465-aa1c-b4002d4e9792'} Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 565b3109-ab27-4465-aa1c-b4002d4e9792 could not be found. Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:21:53.720613 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 565b3109-ab27-4465-aa1c-b4002d4e9792 could not be found. Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 565b3109-ab27-4465-aa1c-b4002d4e9792 could not be found. Aug 30 05:21:53.722678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:21:53.724255 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4434a0a5-c201-4ed7-81c6-99a8cebe60c0 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Returning 404 to user: Instance 565b3109-ab27-4465-aa1c-b4002d4e9792 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:21:53.724255 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4434a0a5-c201-4ed7-81c6-99a8cebe60c0 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792" status: 404 len: 111 microversion: 2.1 time: 0.033033 Aug 30 05:21:53.724255 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 544/1057] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:53 2022] GET /compute/v2.1/servers/565b3109-ab27-4465-aa1c-b4002d4e9792 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:21:53.728791 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4673bbde-0351-4d83-9f5d-1e66ec67aa37 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] Calling method '.version_select at 0x7f822ec0eaf0>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:53.748110 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4673bbde-0351-4d83-9f5d-1e66ec67aa37 tempest-TestMinimumBasicScenario-1648859406 tempest-TestMinimumBasicScenario-1648859406-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-920382813" status: 202 len: 0 microversion: 2.1 time: 0.023291 Aug 30 05:21:53.748688 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 514/1058] 10.222.0.77 () {58 vars in 1269 bytes} [Tue Aug 30 05:21:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-920382813 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:21:54.150513 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b6fdd1bb-b30d-4272-8c8b-666303ba00e5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:54.151185 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b6fdd1bb-b30d-4272-8c8b-666303ba00e5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:54.157780 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6fdd1bb-b30d-4272-8c8b-666303ba00e5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:54.159665 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6fdd1bb-b30d-4272-8c8b-666303ba00e5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:54.160312 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6fdd1bb-b30d-4272-8c8b-666303ba00e5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:54.161038 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6fdd1bb-b30d-4272-8c8b-666303ba00e5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:54.161952 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6fdd1bb-b30d-4272-8c8b-666303ba00e5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:54.162544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b6fdd1bb-b30d-4272-8c8b-666303ba00e5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:54.433556 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b6fdd1bb-b30d-4272-8c8b-666303ba00e5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:54.443089 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b6fdd1bb-b30d-4272-8c8b-666303ba00e5 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 200 len: 1366 microversion: 2.1 time: 0.296431 Aug 30 05:21:54.457602 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 545/1059] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:54 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:54.782174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-49e99746-ed1a-490d-bf75-67f33140ac30 req-e4d7cf1f-4bf6-4991-99bc-8f9450f59305 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4f3fcb1-0c37-497e-b603-d8fae3e2048a", "tag": "3c621d46-c5fc-4ccc-add5-edce4f04d0e0"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:54.800385 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-49e99746-ed1a-490d-bf75-67f33140ac30 req-e4d7cf1f-4bf6-4991-99bc-8f9450f59305 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:54.801610 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-49e99746-ed1a-490d-bf75-67f33140ac30 req-e4d7cf1f-4bf6-4991-99bc-8f9450f59305 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:54.802337 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-49e99746-ed1a-490d-bf75-67f33140ac30 req-e4d7cf1f-4bf6-4991-99bc-8f9450f59305 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:54.814038 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-49e99746-ed1a-490d-bf75-67f33140ac30 req-e4d7cf1f-4bf6-4991-99bc-8f9450f59305 service nova] Creating event network-changed:3c621d46-c5fc-4ccc-add5-edce4f04d0e0 for instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a on hv-cinder-85391 Aug 30 05:21:54.820724 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-49e99746-ed1a-490d-bf75-67f33140ac30 req-e4d7cf1f-4bf6-4991-99bc-8f9450f59305 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043843 Aug 30 05:21:54.821768 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 515/1060] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:21:55.466199 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9a64979b-35b6-43ec-a3c4-f0437601c0b7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:55.466924 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9a64979b-35b6-43ec-a3c4-f0437601c0b7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:55.473839 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a64979b-35b6-43ec-a3c4-f0437601c0b7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:55.474324 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a64979b-35b6-43ec-a3c4-f0437601c0b7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:55.474759 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a64979b-35b6-43ec-a3c4-f0437601c0b7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:55.475485 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a64979b-35b6-43ec-a3c4-f0437601c0b7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:55.475933 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a64979b-35b6-43ec-a3c4-f0437601c0b7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:55.476353 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9a64979b-35b6-43ec-a3c4-f0437601c0b7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:55.495012 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:55.619241 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9a64979b-35b6-43ec-a3c4-f0437601c0b7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:55.628946 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9a64979b-35b6-43ec-a3c4-f0437601c0b7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 200 len: 1366 microversion: 2.1 time: 0.167086 Aug 30 05:21:55.629522 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 546/1061] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:55 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:56.651148 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ad0242e5-2a26-42fa-b730-ddcd5ef0d944 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:56.651929 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ad0242e5-2a26-42fa-b730-ddcd5ef0d944 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:56.658003 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad0242e5-2a26-42fa-b730-ddcd5ef0d944 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:56.658483 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad0242e5-2a26-42fa-b730-ddcd5ef0d944 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:56.659534 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad0242e5-2a26-42fa-b730-ddcd5ef0d944 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:56.660265 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad0242e5-2a26-42fa-b730-ddcd5ef0d944 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:56.660770 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad0242e5-2a26-42fa-b730-ddcd5ef0d944 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:56.661238 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ad0242e5-2a26-42fa-b730-ddcd5ef0d944 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:56.793853 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ad0242e5-2a26-42fa-b730-ddcd5ef0d944 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:56.801874 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ad0242e5-2a26-42fa-b730-ddcd5ef0d944 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 200 len: 1366 microversion: 2.1 time: 0.155561 Aug 30 05:21:56.802388 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 516/1062] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:56 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:57.824401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f1f21e41-0869-4f0e-b561-3ffc52e7379f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:57.825516 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f1f21e41-0869-4f0e-b561-3ffc52e7379f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:57.833019 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1f21e41-0869-4f0e-b561-3ffc52e7379f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:57.833729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1f21e41-0869-4f0e-b561-3ffc52e7379f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:57.834343 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1f21e41-0869-4f0e-b561-3ffc52e7379f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:57.835392 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1f21e41-0869-4f0e-b561-3ffc52e7379f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:57.836130 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1f21e41-0869-4f0e-b561-3ffc52e7379f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:57.836705 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f1f21e41-0869-4f0e-b561-3ffc52e7379f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:58.039723 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f1f21e41-0869-4f0e-b561-3ffc52e7379f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:58.051060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f1f21e41-0869-4f0e-b561-3ffc52e7379f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 200 len: 1366 microversion: 2.1 time: 0.231360 Aug 30 05:21:58.067485 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 547/1063] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:57 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:59.073640 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-3646a7e3-99bd-422d-a0a6-406c61849079 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:59.074246 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-3646a7e3-99bd-422d-a0a6-406c61849079 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:59.080798 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3646a7e3-99bd-422d-a0a6-406c61849079 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:59.081294 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3646a7e3-99bd-422d-a0a6-406c61849079 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:59.081733 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3646a7e3-99bd-422d-a0a6-406c61849079 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:59.082574 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3646a7e3-99bd-422d-a0a6-406c61849079 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:59.082924 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3646a7e3-99bd-422d-a0a6-406c61849079 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:59.083355 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-3646a7e3-99bd-422d-a0a6-406c61849079 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:59.311968 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-3646a7e3-99bd-422d-a0a6-406c61849079 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:59.319952 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-3646a7e3-99bd-422d-a0a6-406c61849079 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 200 len: 1366 microversion: 2.1 time: 0.250247 Aug 30 05:21:59.320656 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 517/1064] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:59 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:00.193093 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-85d43bb2-ce69-4d5e-96b0-60850663ee75 req-d3e78aa9-ffef-4c16-b943-5827988face9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4f3fcb1-0c37-497e-b603-d8fae3e2048a", "name": "network-vif-plugged", "status": "completed", "tag": "3c621d46-c5fc-4ccc-add5-edce4f04d0e0"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:22:00.204079 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-85d43bb2-ce69-4d5e-96b0-60850663ee75 req-d3e78aa9-ffef-4c16-b943-5827988face9 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:00.204644 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-85d43bb2-ce69-4d5e-96b0-60850663ee75 req-d3e78aa9-ffef-4c16-b943-5827988face9 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:00.204973 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-85d43bb2-ce69-4d5e-96b0-60850663ee75 req-d3e78aa9-ffef-4c16-b943-5827988face9 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:00.217697 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-85d43bb2-ce69-4d5e-96b0-60850663ee75 req-d3e78aa9-ffef-4c16-b943-5827988face9 service nova] Creating event network-vif-plugged:3c621d46-c5fc-4ccc-add5-edce4f04d0e0 for instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a on hv-cinder-85391 Aug 30 05:22:00.222733 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-85d43bb2-ce69-4d5e-96b0-60850663ee75 req-d3e78aa9-ffef-4c16-b943-5827988face9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034484 Aug 30 05:22:00.223370 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 548/1065] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:22:00.340959 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dc3ab23d-26d1-414d-8a1c-aab0477ace99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:00.342239 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dc3ab23d-26d1-414d-8a1c-aab0477ace99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:00.349254 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc3ab23d-26d1-414d-8a1c-aab0477ace99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:00.350599 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc3ab23d-26d1-414d-8a1c-aab0477ace99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:00.351093 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc3ab23d-26d1-414d-8a1c-aab0477ace99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:00.352034 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc3ab23d-26d1-414d-8a1c-aab0477ace99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:00.352506 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc3ab23d-26d1-414d-8a1c-aab0477ace99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:00.352941 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dc3ab23d-26d1-414d-8a1c-aab0477ace99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:00.357776 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:00.510481 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dc3ab23d-26d1-414d-8a1c-aab0477ace99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:00.519596 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dc3ab23d-26d1-414d-8a1c-aab0477ace99 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 200 len: 1366 microversion: 2.1 time: 0.181913 Aug 30 05:22:00.520347 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 518/1066] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:00 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:01.541050 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1b0f4d8e-7e6c-4539-9a05-483fd410bf01 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:01.541752 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1b0f4d8e-7e6c-4539-9a05-483fd410bf01 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:01.553607 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b0f4d8e-7e6c-4539-9a05-483fd410bf01 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:01.554101 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b0f4d8e-7e6c-4539-9a05-483fd410bf01 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:01.554547 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b0f4d8e-7e6c-4539-9a05-483fd410bf01 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:01.555286 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b0f4d8e-7e6c-4539-9a05-483fd410bf01 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:01.555739 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b0f4d8e-7e6c-4539-9a05-483fd410bf01 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:01.556163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1b0f4d8e-7e6c-4539-9a05-483fd410bf01 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:01.708584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1b0f4d8e-7e6c-4539-9a05-483fd410bf01 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:01.717110 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1b0f4d8e-7e6c-4539-9a05-483fd410bf01 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 200 len: 1366 microversion: 2.1 time: 0.180142 Aug 30 05:22:01.717838 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 549/1067] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:01 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:02.737746 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-62b6c7ee-5458-4bca-a112-f1424e1afc87 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:02.738369 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-62b6c7ee-5458-4bca-a112-f1424e1afc87 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:02.740613 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=6 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:02.746524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62b6c7ee-5458-4bca-a112-f1424e1afc87 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:02.747157 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62b6c7ee-5458-4bca-a112-f1424e1afc87 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:02.747605 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62b6c7ee-5458-4bca-a112-f1424e1afc87 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:02.748315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62b6c7ee-5458-4bca-a112-f1424e1afc87 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:02.748780 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62b6c7ee-5458-4bca-a112-f1424e1afc87 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:02.749215 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-62b6c7ee-5458-4bca-a112-f1424e1afc87 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:02.876624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-62b6c7ee-5458-4bca-a112-f1424e1afc87 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:02.884731 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-62b6c7ee-5458-4bca-a112-f1424e1afc87 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 200 len: 1556 microversion: 2.1 time: 0.151108 Aug 30 05:22:02.885301 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 519/1068] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:02 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:02.905274 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f3a15189-d5cb-41ad-b43f-b8e122ace9f3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:02.905787 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f3a15189-d5cb-41ad-b43f-b8e122ace9f3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:02.907757 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:02.908410 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:02.914575 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3a15189-d5cb-41ad-b43f-b8e122ace9f3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:02.915088 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3a15189-d5cb-41ad-b43f-b8e122ace9f3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:02.915530 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3a15189-d5cb-41ad-b43f-b8e122ace9f3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:02.916222 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3a15189-d5cb-41ad-b43f-b8e122ace9f3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:02.916678 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3a15189-d5cb-41ad-b43f-b8e122ace9f3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:02.917108 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f3a15189-d5cb-41ad-b43f-b8e122ace9f3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:02.995982 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f3a15189-d5cb-41ad-b43f-b8e122ace9f3 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094508 Aug 30 05:22:02.996568 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 550/1069] 10.222.0.77 () {58 vars in 1275 bytes} [Tue Aug 30 05:22:02 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:22:04.030087 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-c297a482-c5cc-46ba-a1a8-26f934504518 req-79476872-f82e-4897-a1f7-c9f1816f03c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4f3fcb1-0c37-497e-b603-d8fae3e2048a", "tag": "3c621d46-c5fc-4ccc-add5-edce4f04d0e0"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:22:04.041575 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c297a482-c5cc-46ba-a1a8-26f934504518 req-79476872-f82e-4897-a1f7-c9f1816f03c9 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:04.042844 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c297a482-c5cc-46ba-a1a8-26f934504518 req-79476872-f82e-4897-a1f7-c9f1816f03c9 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:04.043431 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c297a482-c5cc-46ba-a1a8-26f934504518 req-79476872-f82e-4897-a1f7-c9f1816f03c9 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:04.060315 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-c297a482-c5cc-46ba-a1a8-26f934504518 req-79476872-f82e-4897-a1f7-c9f1816f03c9 service nova] Creating event network-changed:3c621d46-c5fc-4ccc-add5-edce4f04d0e0 for instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a on hv-cinder-85391 Aug 30 05:22:04.066302 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-c297a482-c5cc-46ba-a1a8-26f934504518 req-79476872-f82e-4897-a1f7-c9f1816f03c9 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039704 Aug 30 05:22:04.067028 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 520/1070] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:22:19.727707 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:19.728939 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=20 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:19.731042 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:19.732131 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=12 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:19.734013 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4635156a-1a21-4ae8-8dbc-dc901236a6f8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:19.734910 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4635156a-1a21-4ae8-8dbc-dc901236a6f8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:19.737616 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-79212379-8776-43c9-acde-dca45e1e033e req-84e1ffa8-e7fd-4ba9-b203-113dcec953a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d44a2416-35ea-4b7d-b8b6-a68d9d578ca5", "tag": "7450aa1e-23d7-43dd-a88d-807ca70eed93"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:22:19.743521 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4635156a-1a21-4ae8-8dbc-dc901236a6f8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:19.744145 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4635156a-1a21-4ae8-8dbc-dc901236a6f8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:19.744598 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4635156a-1a21-4ae8-8dbc-dc901236a6f8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:19.745483 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4635156a-1a21-4ae8-8dbc-dc901236a6f8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:19.745947 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4635156a-1a21-4ae8-8dbc-dc901236a6f8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:19.746376 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4635156a-1a21-4ae8-8dbc-dc901236a6f8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:19.748037 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-79212379-8776-43c9-acde-dca45e1e033e req-84e1ffa8-e7fd-4ba9-b203-113dcec953a4 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:19.748597 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-79212379-8776-43c9-acde-dca45e1e033e req-84e1ffa8-e7fd-4ba9-b203-113dcec953a4 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:19.749100 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-79212379-8776-43c9-acde-dca45e1e033e req-84e1ffa8-e7fd-4ba9-b203-113dcec953a4 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:19.761551 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-79212379-8776-43c9-acde-dca45e1e033e req-84e1ffa8-e7fd-4ba9-b203-113dcec953a4 service nova] Creating event network-changed:7450aa1e-23d7-43dd-a88d-807ca70eed93 for instance d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 on hv-cinder-85391 Aug 30 05:22:19.767334 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-79212379-8776-43c9-acde-dca45e1e033e req-84e1ffa8-e7fd-4ba9-b203-113dcec953a4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038166 Aug 30 05:22:19.768950 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 521/1071] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:22:19.775132 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4635156a-1a21-4ae8-8dbc-dc901236a6f8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:22:19.862083 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4635156a-1a21-4ae8-8dbc-dc901236a6f8 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "DELETE /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 204 len: 0 microversion: 2.1 time: 0.135271 Aug 30 05:22:19.866915 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 551/1072] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:22:19 2022] DELETE /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:22:19.872684 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-80c188dc-54cc-4e8b-80d2-3c1634172b19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:19.873396 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-80c188dc-54cc-4e8b-80d2-3c1634172b19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:19.880247 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80c188dc-54cc-4e8b-80d2-3c1634172b19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:19.880747 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80c188dc-54cc-4e8b-80d2-3c1634172b19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:19.881188 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80c188dc-54cc-4e8b-80d2-3c1634172b19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:19.881907 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80c188dc-54cc-4e8b-80d2-3c1634172b19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:19.882361 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80c188dc-54cc-4e8b-80d2-3c1634172b19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:19.883021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-80c188dc-54cc-4e8b-80d2-3c1634172b19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:20.042914 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-80c188dc-54cc-4e8b-80d2-3c1634172b19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:20.052126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-80c188dc-54cc-4e8b-80d2-3c1634172b19 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1577 microversion: 2.1 time: 0.183998 Aug 30 05:22:20.052740 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 522/1073] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:19 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:22:21.074089 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d893b2d8-e6d0-4273-add2-0f6ddac07866 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:21.074791 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d893b2d8-e6d0-4273-add2-0f6ddac07866 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:21.081072 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d893b2d8-e6d0-4273-add2-0f6ddac07866 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:21.081554 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d893b2d8-e6d0-4273-add2-0f6ddac07866 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:21.081994 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d893b2d8-e6d0-4273-add2-0f6ddac07866 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:21.082682 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d893b2d8-e6d0-4273-add2-0f6ddac07866 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:21.083162 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d893b2d8-e6d0-4273-add2-0f6ddac07866 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:21.083584 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d893b2d8-e6d0-4273-add2-0f6ddac07866 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:21.215228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-d893b2d8-e6d0-4273-add2-0f6ddac07866 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:21.223753 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d893b2d8-e6d0-4273-add2-0f6ddac07866 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1577 microversion: 2.1 time: 0.153920 Aug 30 05:22:21.224339 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 552/1074] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:21 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:22.232495 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-15628dfb-50cd-46be-a10e-3f01879799cf req-cfc74af0-813b-42e4-94d6-fbadac9fccb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d44a2416-35ea-4b7d-b8b6-a68d9d578ca5", "name": "network-vif-deleted", "tag": "7450aa1e-23d7-43dd-a88d-807ca70eed93"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:22:22.244874 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-81da34e2-6c5f-4044-9ba9-9301387411c0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:22.245464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-15628dfb-50cd-46be-a10e-3f01879799cf req-cfc74af0-813b-42e4-94d6-fbadac9fccb4 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:22.245464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-15628dfb-50cd-46be-a10e-3f01879799cf req-cfc74af0-813b-42e4-94d6-fbadac9fccb4 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:22.245697 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-81da34e2-6c5f-4044-9ba9-9301387411c0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:22.245831 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-15628dfb-50cd-46be-a10e-3f01879799cf req-cfc74af0-813b-42e4-94d6-fbadac9fccb4 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:22.252716 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81da34e2-6c5f-4044-9ba9-9301387411c0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:22.253248 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81da34e2-6c5f-4044-9ba9-9301387411c0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:22.253663 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81da34e2-6c5f-4044-9ba9-9301387411c0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:22.254410 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81da34e2-6c5f-4044-9ba9-9301387411c0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:22.254915 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81da34e2-6c5f-4044-9ba9-9301387411c0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:22.255366 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81da34e2-6c5f-4044-9ba9-9301387411c0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:22.260576 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-15628dfb-50cd-46be-a10e-3f01879799cf req-cfc74af0-813b-42e4-94d6-fbadac9fccb4 service nova] Creating event network-vif-deleted:7450aa1e-23d7-43dd-a88d-807ca70eed93 for instance d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 on hv-cinder-85391 Aug 30 05:22:22.266500 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-15628dfb-50cd-46be-a10e-3f01879799cf req-cfc74af0-813b-42e4-94d6-fbadac9fccb4 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037581 Aug 30 05:22:22.267134 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 523/1075] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:22:22.325795 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-81da34e2-6c5f-4044-9ba9-9301387411c0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:22.333767 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-81da34e2-6c5f-4044-9ba9-9301387411c0 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 200 len: 1226 microversion: 2.1 time: 0.092716 Aug 30 05:22:22.334380 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 553/1076] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:22 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:23.355045 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1421a80f-f4ad-48ec-9414-f51f0cc1394b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:23.355757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1421a80f-f4ad-48ec-9414-f51f0cc1394b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: d44a2416-35ea-4b7d-b8b6-a68d9d578ca5] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:23.362749 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1421a80f-f4ad-48ec-9414-f51f0cc1394b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:23.363273 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1421a80f-f4ad-48ec-9414-f51f0cc1394b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:23.363714 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1421a80f-f4ad-48ec-9414-f51f0cc1394b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:23.364411 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1421a80f-f4ad-48ec-9414-f51f0cc1394b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:23.364876 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1421a80f-f4ad-48ec-9414-f51f0cc1394b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:23.365307 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1421a80f-f4ad-48ec-9414-f51f0cc1394b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:23.378788 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-1421a80f-f4ad-48ec-9414-f51f0cc1394b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] HTTP exception thrown: Instance d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 could not be found. Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1421a80f-f4ad-48ec-9414-f51f0cc1394b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Request method failure captured: Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 HTTP/1.1 Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZzF-LSzrjkuGaxRc0MLonAu55I9uAT9VebYV8aNWg0pE7DQoGlGuMEv4e49aGHio6uqGTTYNtBBoHVA4WKyN4AYzzrBv8RP-GfYF2CDv4uyfDme1msVJKQv_0JdqT6Fk_aFes8BF-oCX0JHEQEZrNKhuHgCcXqfHTFyHcqaBKPuWmY Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: 97e3452b02294219ae56cd23eb2aa0ce Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-TestVolumeBootPattern-1802884946 Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:22:23.380406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:22:23.382130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/97e3452b02294219ae56cd23eb2aa0ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/97e3452b02294219ae56cd23eb2aa0ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/97e3452b02294219ae56cd23eb2aa0ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_97e3452b02294219ae56cd23eb2aa0ce", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:22:23.382130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-TestVolumeBootPattern-1802884946 Aug 30 05:22:23.382130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 97e3452b02294219ae56cd23eb2aa0ce Aug 30 05:22:23.382130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802884946 Aug 30 05:22:23.382130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-TestVolumeBootPattern-1802884946-project Aug 30 05:22:23.382130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:22:23.382130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:22:23.382130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: 9256fd43e5124fb68d4e5453584d1e8d Aug 30 05:22:23.382130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-TestVolumeBootPattern-1802884946-project Aug 30 05:22:23.382130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:22:23.382130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 could not be found. Aug 30 05:22:23.382130 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': 'd44a2416-35ea-4b7d-b8b6-a68d9d578ca5'} Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 could not be found. Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:22:23.383021 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 could not be found. Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 could not be found. Aug 30 05:22:23.384590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:23.386003 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1421a80f-f4ad-48ec-9414-f51f0cc1394b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Returning 404 to user: Instance d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:22:23.386003 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1421a80f-f4ad-48ec-9414-f51f0cc1394b tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5" status: 404 len: 111 microversion: 2.1 time: 0.031077 Aug 30 05:22:23.386003 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 524/1077] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:23 2022] GET /compute/v2.1/servers/d44a2416-35ea-4b7d-b8b6-a68d9d578ca5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:22:26.419512 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8ed5b506-1d72-440b-9e7d-022199e86267 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:26.420211 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8ed5b506-1d72-440b-9e7d-022199e86267 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:26.421863 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-c45d9159-59a5-488d-8fe5-d93aa55f4f42 req-b7672775-bf64-4aaf-8ebb-212d0b79f65f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23b1f7be-c451-470d-8117-4dd0164f568b", "tag": "33dc5fe2-b49b-46cd-bbea-d50e70e21301"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:22:26.427085 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ed5b506-1d72-440b-9e7d-022199e86267 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:26.427656 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ed5b506-1d72-440b-9e7d-022199e86267 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:26.428987 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ed5b506-1d72-440b-9e7d-022199e86267 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:26.429449 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ed5b506-1d72-440b-9e7d-022199e86267 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:26.429989 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ed5b506-1d72-440b-9e7d-022199e86267 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:26.430474 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8ed5b506-1d72-440b-9e7d-022199e86267 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:26.432570 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c45d9159-59a5-488d-8fe5-d93aa55f4f42 req-b7672775-bf64-4aaf-8ebb-212d0b79f65f service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:26.433118 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c45d9159-59a5-488d-8fe5-d93aa55f4f42 req-b7672775-bf64-4aaf-8ebb-212d0b79f65f service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:26.433637 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c45d9159-59a5-488d-8fe5-d93aa55f4f42 req-b7672775-bf64-4aaf-8ebb-212d0b79f65f service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:26.445739 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-c45d9159-59a5-488d-8fe5-d93aa55f4f42 req-b7672775-bf64-4aaf-8ebb-212d0b79f65f service nova] Creating event network-changed:33dc5fe2-b49b-46cd-bbea-d50e70e21301 for instance 23b1f7be-c451-470d-8117-4dd0164f568b on hv-cinder-85391 Aug 30 05:22:26.450888 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-c45d9159-59a5-488d-8fe5-d93aa55f4f42 req-b7672775-bf64-4aaf-8ebb-212d0b79f65f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032600 Aug 30 05:22:26.452128 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 525/1078] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:22:26.457158 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8ed5b506-1d72-440b-9e7d-022199e86267 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:22:26.544549 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8ed5b506-1d72-440b-9e7d-022199e86267 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "DELETE /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 204 len: 0 microversion: 2.1 time: 0.128461 Aug 30 05:22:26.545445 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 554/1079] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:22:26 2022] DELETE /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:22:26.555213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-54a189a3-ec39-4f2b-9939-707b584ede34 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:26.556303 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-54a189a3-ec39-4f2b-9939-707b584ede34 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:26.564496 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54a189a3-ec39-4f2b-9939-707b584ede34 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:26.565330 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54a189a3-ec39-4f2b-9939-707b584ede34 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:26.566082 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54a189a3-ec39-4f2b-9939-707b584ede34 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:26.567044 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54a189a3-ec39-4f2b-9939-707b584ede34 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:26.567848 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54a189a3-ec39-4f2b-9939-707b584ede34 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:26.568595 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-54a189a3-ec39-4f2b-9939-707b584ede34 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:26.934285 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-54a189a3-ec39-4f2b-9939-707b584ede34 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:26.942590 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-54a189a3-ec39-4f2b-9939-707b584ede34 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1576 microversion: 2.1 time: 0.392598 Aug 30 05:22:26.943384 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 526/1080] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:26 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1576 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:27.965192 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c3fdbbea-5c27-49ba-b529-2e7c8c26c3d3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:27.965901 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c3fdbbea-5c27-49ba-b529-2e7c8c26c3d3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:27.972856 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fdbbea-5c27-49ba-b529-2e7c8c26c3d3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:27.973349 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fdbbea-5c27-49ba-b529-2e7c8c26c3d3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:27.973792 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fdbbea-5c27-49ba-b529-2e7c8c26c3d3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:27.974501 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fdbbea-5c27-49ba-b529-2e7c8c26c3d3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:27.974990 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fdbbea-5c27-49ba-b529-2e7c8c26c3d3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:27.975419 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c3fdbbea-5c27-49ba-b529-2e7c8c26c3d3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:28.208644 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c3fdbbea-5c27-49ba-b529-2e7c8c26c3d3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:28.217108 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c3fdbbea-5c27-49ba-b529-2e7c8c26c3d3 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1576 microversion: 2.1 time: 0.256390 Aug 30 05:22:28.217689 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 555/1081] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:27 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1576 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:28.672936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-a1b7046d-c7ef-45e0-8b51-1246a063d348 req-be1966f7-9df1-42ef-9372-8b0b3c33038e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23b1f7be-c451-470d-8117-4dd0164f568b", "name": "network-vif-deleted", "tag": "33dc5fe2-b49b-46cd-bbea-d50e70e21301"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:22:28.682859 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a1b7046d-c7ef-45e0-8b51-1246a063d348 req-be1966f7-9df1-42ef-9372-8b0b3c33038e service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:28.683341 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a1b7046d-c7ef-45e0-8b51-1246a063d348 req-be1966f7-9df1-42ef-9372-8b0b3c33038e service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:28.683771 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-a1b7046d-c7ef-45e0-8b51-1246a063d348 req-be1966f7-9df1-42ef-9372-8b0b3c33038e service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:28.695373 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-a1b7046d-c7ef-45e0-8b51-1246a063d348 req-be1966f7-9df1-42ef-9372-8b0b3c33038e service nova] Creating event network-vif-deleted:33dc5fe2-b49b-46cd-bbea-d50e70e21301 for instance 23b1f7be-c451-470d-8117-4dd0164f568b on hv-cinder-85391 Aug 30 05:22:28.700079 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-a1b7046d-c7ef-45e0-8b51-1246a063d348 req-be1966f7-9df1-42ef-9372-8b0b3c33038e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030924 Aug 30 05:22:28.700665 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 527/1082] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:22:29.239340 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1d195ba6-c7e8-4f17-83ca-5c416e8bfdb1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:29.239870 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1d195ba6-c7e8-4f17-83ca-5c416e8bfdb1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:29.246792 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d195ba6-c7e8-4f17-83ca-5c416e8bfdb1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:29.247298 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d195ba6-c7e8-4f17-83ca-5c416e8bfdb1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:29.247738 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d195ba6-c7e8-4f17-83ca-5c416e8bfdb1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:29.248422 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d195ba6-c7e8-4f17-83ca-5c416e8bfdb1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:29.248869 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d195ba6-c7e8-4f17-83ca-5c416e8bfdb1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:29.249311 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d195ba6-c7e8-4f17-83ca-5c416e8bfdb1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:29.278784 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d195ba6-c7e8-4f17-83ca-5c416e8bfdb1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:29.279293 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d195ba6-c7e8-4f17-83ca-5c416e8bfdb1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:29.279724 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1d195ba6-c7e8-4f17-83ca-5c416e8bfdb1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:29.280161 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-1d195ba6-c7e8-4f17-83ca-5c416e8bfdb1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lazy-loading 'fault' on Instance uuid 23b1f7be-c451-470d-8117-4dd0164f568b {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:22:29.321463 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1d195ba6-c7e8-4f17-83ca-5c416e8bfdb1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9256fd43e5124fb68d4e5453584d1e8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97e3452b02294219ae56cd23eb2aa0ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:29.329198 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1d195ba6-c7e8-4f17-83ca-5c416e8bfdb1 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 200 len: 1230 microversion: 2.1 time: 0.094380 Aug 30 05:22:29.329763 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 556/1083] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:29 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:30.351387 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7501430a-2dc4-4808-b358-5da103e19a01 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:30.352081 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7501430a-2dc4-4808-b358-5da103e19a01 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: 23b1f7be-c451-470d-8117-4dd0164f568b] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:30.358060 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7501430a-2dc4-4808-b358-5da103e19a01 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:30.358539 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7501430a-2dc4-4808-b358-5da103e19a01 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:30.359009 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7501430a-2dc4-4808-b358-5da103e19a01 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:30.359698 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7501430a-2dc4-4808-b358-5da103e19a01 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:30.360151 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7501430a-2dc4-4808-b358-5da103e19a01 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:30.360575 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7501430a-2dc4-4808-b358-5da103e19a01 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:30.374010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-7501430a-2dc4-4808-b358-5da103e19a01 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] HTTP exception thrown: Instance 23b1f7be-c451-470d-8117-4dd0164f568b could not be found. Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7501430a-2dc4-4808-b358-5da103e19a01 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Request method failure captured: Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b HTTP/1.1 Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZzF-LSzrjkuGaxRc0MLonAu55I9uAT9VebYV8aNWg0pE7DQoGlGuMEv4e49aGHio6uqGTTYNtBBoHVA4WKyN4AYzzrBv8RP-GfYF2CDv4uyfDme1msVJKQv_0JdqT6Fk_aFes8BF-oCX0JHEQEZrNKhuHgCcXqfHTFyHcqaBKPuWmY Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: 97e3452b02294219ae56cd23eb2aa0ce Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-TestVolumeBootPattern-1802884946 Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:22:30.375624 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:22:30.377287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/97e3452b02294219ae56cd23eb2aa0ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/97e3452b02294219ae56cd23eb2aa0ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/97e3452b02294219ae56cd23eb2aa0ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_97e3452b02294219ae56cd23eb2aa0ce", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:22:30.377287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-TestVolumeBootPattern-1802884946 Aug 30 05:22:30.377287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 97e3452b02294219ae56cd23eb2aa0ce Aug 30 05:22:30.377287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802884946 Aug 30 05:22:30.377287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-TestVolumeBootPattern-1802884946-project Aug 30 05:22:30.377287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:22:30.377287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:22:30.377287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: 9256fd43e5124fb68d4e5453584d1e8d Aug 30 05:22:30.377287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-TestVolumeBootPattern-1802884946-project Aug 30 05:22:30.377287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:22:30.377287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance 23b1f7be-c451-470d-8117-4dd0164f568b could not be found. Aug 30 05:22:30.377287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': '23b1f7be-c451-470d-8117-4dd0164f568b'} Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23b1f7be-c451-470d-8117-4dd0164f568b could not be found. Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:22:30.379017 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23b1f7be-c451-470d-8117-4dd0164f568b could not be found. Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23b1f7be-c451-470d-8117-4dd0164f568b could not be found. Aug 30 05:22:30.380533 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:30.381966 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7501430a-2dc4-4808-b358-5da103e19a01 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Returning 404 to user: Instance 23b1f7be-c451-470d-8117-4dd0164f568b could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:22:30.381966 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7501430a-2dc4-4808-b358-5da103e19a01 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b" status: 404 len: 111 microversion: 2.1 time: 0.030371 Aug 30 05:22:30.381966 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 528/1084] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:30 2022] GET /compute/v2.1/servers/23b1f7be-c451-470d-8117-4dd0164f568b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:22:30.807082 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3f0956cf-a1ca-4703-ab04-7560e175afc9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:30.807608 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3f0956cf-a1ca-4703-ab04-7560e175afc9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:30.813596 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f0956cf-a1ca-4703-ab04-7560e175afc9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:30.814075 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f0956cf-a1ca-4703-ab04-7560e175afc9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:30.814508 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f0956cf-a1ca-4703-ab04-7560e175afc9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:30.815223 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f0956cf-a1ca-4703-ab04-7560e175afc9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:30.815671 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f0956cf-a1ca-4703-ab04-7560e175afc9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:30.816093 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3f0956cf-a1ca-4703-ab04-7560e175afc9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:30.828950 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-3f0956cf-a1ca-4703-ab04-7560e175afc9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] HTTP exception thrown: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3f0956cf-a1ca-4703-ab04-7560e175afc9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Request method failure captured: Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: DELETE /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 HTTP/1.1 Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZzF-LSzrjkuGaxRc0MLonAu55I9uAT9VebYV8aNWg0pE7DQoGlGuMEv4e49aGHio6uqGTTYNtBBoHVA4WKyN4AYzzrBv8RP-GfYF2CDv4uyfDme1msVJKQv_0JdqT6Fk_aFes8BF-oCX0JHEQEZrNKhuHgCcXqfHTFyHcqaBKPuWmY Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 97e3452b02294219ae56cd23eb2aa0ce Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-TestVolumeBootPattern-1802884946 Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:22:30.830612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:22:30.832273 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/97e3452b02294219ae56cd23eb2aa0ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/97e3452b02294219ae56cd23eb2aa0ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/97e3452b02294219ae56cd23eb2aa0ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_97e3452b02294219ae56cd23eb2aa0ce", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:22:30.832273 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-TestVolumeBootPattern-1802884946 Aug 30 05:22:30.832273 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 97e3452b02294219ae56cd23eb2aa0ce Aug 30 05:22:30.832273 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802884946 Aug 30 05:22:30.832273 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-TestVolumeBootPattern-1802884946-project Aug 30 05:22:30.832273 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:22:30.832273 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:22:30.832273 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: 9256fd43e5124fb68d4e5453584d1e8d Aug 30 05:22:30.832273 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-TestVolumeBootPattern-1802884946-project Aug 30 05:22:30.832273 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:22:30.832273 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. Aug 30 05:22:30.832273 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': 'e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6'} Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:22:30.833133 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. Aug 30 05:22:30.834624 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:30.836230 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3f0956cf-a1ca-4703-ab04-7560e175afc9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Returning 404 to user: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:22:30.836230 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3f0956cf-a1ca-4703-ab04-7560e175afc9 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 404 len: 111 microversion: 2.1 time: 0.029011 Aug 30 05:22:30.836230 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 557/1085] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:22:30 2022] DELETE /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:22:30.840970 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-33ea5804-e522-4739-a9e2-a56c24ec7f22 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:30.841618 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-33ea5804-e522-4739-a9e2-a56c24ec7f22 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] [instance: e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:30.848003 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33ea5804-e522-4739-a9e2-a56c24ec7f22 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:30.848488 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33ea5804-e522-4739-a9e2-a56c24ec7f22 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:30.848927 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33ea5804-e522-4739-a9e2-a56c24ec7f22 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:30.849613 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33ea5804-e522-4739-a9e2-a56c24ec7f22 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:30.850073 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33ea5804-e522-4739-a9e2-a56c24ec7f22 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:30.850499 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-33ea5804-e522-4739-a9e2-a56c24ec7f22 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:30.864266 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-33ea5804-e522-4739-a9e2-a56c24ec7f22 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] HTTP exception thrown: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-33ea5804-e522-4739-a9e2-a56c24ec7f22 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Request method failure captured: Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 HTTP/1.1 Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZzF-LSzrjkuGaxRc0MLonAu55I9uAT9VebYV8aNWg0pE7DQoGlGuMEv4e49aGHio6uqGTTYNtBBoHVA4WKyN4AYzzrBv8RP-GfYF2CDv4uyfDme1msVJKQv_0JdqT6Fk_aFes8BF-oCX0JHEQEZrNKhuHgCcXqfHTFyHcqaBKPuWmY Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: 97e3452b02294219ae56cd23eb2aa0ce Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-TestVolumeBootPattern-1802884946 Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:22:30.865757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:22:30.867406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/97e3452b02294219ae56cd23eb2aa0ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/97e3452b02294219ae56cd23eb2aa0ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/97e3452b02294219ae56cd23eb2aa0ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_97e3452b02294219ae56cd23eb2aa0ce", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:22:30.867406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-TestVolumeBootPattern-1802884946 Aug 30 05:22:30.867406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: 97e3452b02294219ae56cd23eb2aa0ce Aug 30 05:22:30.867406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-TestVolumeBootPattern-1802884946 Aug 30 05:22:30.867406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-TestVolumeBootPattern-1802884946-project Aug 30 05:22:30.867406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:22:30.867406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:22:30.867406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: 9256fd43e5124fb68d4e5453584d1e8d Aug 30 05:22:30.867406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-TestVolumeBootPattern-1802884946-project Aug 30 05:22:30.867406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:22:30.867406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. Aug 30 05:22:30.867406 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': 'e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6'} Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:22:30.868213 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. Aug 30 05:22:30.869464 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:30.870564 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-33ea5804-e522-4739-a9e2-a56c24ec7f22 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Returning 404 to user: Instance e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:22:30.870564 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-33ea5804-e522-4739-a9e2-a56c24ec7f22 tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6" status: 404 len: 111 microversion: 2.1 time: 0.030299 Aug 30 05:22:30.870564 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 529/1086] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:30 2022] GET /compute/v2.1/servers/e7ca8d8e-4d2b-47bf-935e-02c4b4ae0da6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:22:32.156329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c580c91f-0fcf-4e96-b810-01e7a9d2cd1e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] Calling method '.version_select at 0x7f822ed3b5e0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:32.176805 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c580c91f-0fcf-4e96-b810-01e7a9d2cd1e tempest-TestVolumeBootPattern-1802884946 tempest-TestVolumeBootPattern-1802884946-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1477137281" status: 202 len: 0 microversion: 2.1 time: 0.024143 Aug 30 05:22:32.177401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 558/1087] 10.222.0.77 () {58 vars in 1263 bytes} [Tue Aug 30 05:22:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1477137281 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:22:40.055742 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-2bca321d-ec15-428b-bb21-e54639cfc54f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:40.056255 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-2bca321d-ec15-428b-bb21-e54639cfc54f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:40.063168 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bca321d-ec15-428b-bb21-e54639cfc54f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:40.063650 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bca321d-ec15-428b-bb21-e54639cfc54f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:40.064080 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bca321d-ec15-428b-bb21-e54639cfc54f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:40.064769 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bca321d-ec15-428b-bb21-e54639cfc54f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:40.065219 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bca321d-ec15-428b-bb21-e54639cfc54f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:40.065642 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-2bca321d-ec15-428b-bb21-e54639cfc54f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:40.089548 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-2bca321d-ec15-428b-bb21-e54639cfc54f tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a/ips" status: 200 len: 150 microversion: 2.1 time: 0.037667 Aug 30 05:22:40.090114 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 530/1088] 10.222.0.77 () {58 vars in 1248 bytes} [Tue Aug 30 05:22:40 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:22:41.410135 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-3ea77bac-6cb9-4d35-b68b-5745cbc36132 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5c39f29-b819-4344-baad-4a6af1cef0b1"}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:22:41.412505 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-3ea77bac-6cb9-4d35-b68b-5745cbc36132 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:41.416043 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:41.421204 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ea77bac-6cb9-4d35-b68b-5745cbc36132 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:41.421795 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ea77bac-6cb9-4d35-b68b-5745cbc36132 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:41.422630 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ea77bac-6cb9-4d35-b68b-5745cbc36132 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:41.422946 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ea77bac-6cb9-4d35-b68b-5745cbc36132 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:41.423404 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ea77bac-6cb9-4d35-b68b-5745cbc36132 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:41.423833 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-3ea77bac-6cb9-4d35-b68b-5745cbc36132 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:41.661716 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-3ea77bac-6cb9-4d35-b68b-5745cbc36132 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "POST /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255929 Aug 30 05:22:41.662313 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 559/1089] 10.222.0.77 () {60 vars in 1323 bytes} [Tue Aug 30 05:22:41 2022] POST /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:22:48.209770 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-72935e85-3ce2-4aea-b689-aa59090d0eb0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:48.210299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-72935e85-3ce2-4aea-b689-aa59090d0eb0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:48.216938 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72935e85-3ce2-4aea-b689-aa59090d0eb0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:48.217416 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72935e85-3ce2-4aea-b689-aa59090d0eb0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:48.217849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72935e85-3ce2-4aea-b689-aa59090d0eb0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:48.218529 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72935e85-3ce2-4aea-b689-aa59090d0eb0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:48.219080 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72935e85-3ce2-4aea-b689-aa59090d0eb0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:48.219498 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-72935e85-3ce2-4aea-b689-aa59090d0eb0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:48.299659 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.objects.instance [None req-72935e85-3ce2-4aea-b689-aa59090d0eb0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lazy-loading 'services' on Instance uuid e4f3fcb1-0c37-497e-b603-d8fae3e2048a {{(pid=120573) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:22:48.368688 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-72935e85-3ce2-4aea-b689-aa59090d0eb0 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a/os-volume_attachments/a5c39f29-b819-4344-baad-4a6af1cef0b1" status: 202 len: 0 microversion: 2.1 time: 0.163129 Aug 30 05:22:48.369296 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 531/1090] 10.222.0.77 () {58 vars in 1416 bytes} [Tue Aug 30 05:22:48 2022] DELETE /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a/os-volume_attachments/a5c39f29-b819-4344-baad-4a6af1cef0b1 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:22:48.378564 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e00436e5-f779-4343-a626-13fcdc20d076 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:48.380920 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e00436e5-f779-4343-a626-13fcdc20d076 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:48.387643 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00436e5-f779-4343-a626-13fcdc20d076 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:48.388140 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00436e5-f779-4343-a626-13fcdc20d076 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:48.388647 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00436e5-f779-4343-a626-13fcdc20d076 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:48.389731 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00436e5-f779-4343-a626-13fcdc20d076 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:48.390035 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00436e5-f779-4343-a626-13fcdc20d076 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:48.390530 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e00436e5-f779-4343-a626-13fcdc20d076 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:48.422899 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e00436e5-f779-4343-a626-13fcdc20d076 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049001 Aug 30 05:22:48.423482 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 560/1091] 10.222.0.77 () {58 vars in 1302 bytes} [Tue Aug 30 05:22:48 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:22:49.436173 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f4c7352e-edd1-4ec9-84d9-0629bf5a28c9 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:49.438437 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f4c7352e-edd1-4ec9-84d9-0629bf5a28c9 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:49.444570 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c7352e-edd1-4ec9-84d9-0629bf5a28c9 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:49.445062 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c7352e-edd1-4ec9-84d9-0629bf5a28c9 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:49.445498 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c7352e-edd1-4ec9-84d9-0629bf5a28c9 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:49.446188 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c7352e-edd1-4ec9-84d9-0629bf5a28c9 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:49.446642 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c7352e-edd1-4ec9-84d9-0629bf5a28c9 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:49.447109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f4c7352e-edd1-4ec9-84d9-0629bf5a28c9 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:49.477177 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f4c7352e-edd1-4ec9-84d9-0629bf5a28c9 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045668 Aug 30 05:22:49.481356 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 532/1092] 10.222.0.77 () {58 vars in 1302 bytes} [Tue Aug 30 05:22:49 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 05:22:49.536998 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ebac3026-f114-4ce0-8517-41605d1764cd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:49.537497 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ebac3026-f114-4ce0-8517-41605d1764cd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:49.543851 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ebac3026-f114-4ce0-8517-41605d1764cd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:49.544330 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ebac3026-f114-4ce0-8517-41605d1764cd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:49.544767 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ebac3026-f114-4ce0-8517-41605d1764cd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:49.545455 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ebac3026-f114-4ce0-8517-41605d1764cd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:49.545907 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ebac3026-f114-4ce0-8517-41605d1764cd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:49.546330 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ebac3026-f114-4ce0-8517-41605d1764cd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:49.571816 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ebac3026-f114-4ce0-8517-41605d1764cd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Going to try to terminate instance {{(pid=120572) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:22:49.646810 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ebac3026-f114-4ce0-8517-41605d1764cd tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 204 len: 0 microversion: 2.1 time: 0.114000 Aug 30 05:22:49.647430 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 561/1093] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:22:49 2022] DELETE /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:22:49.657058 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-86cb3b2b-4b6b-49bc-90c0-000aeab3cbd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:49.657931 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-86cb3b2b-4b6b-49bc-90c0-000aeab3cbd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:49.664359 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86cb3b2b-4b6b-49bc-90c0-000aeab3cbd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:49.664851 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86cb3b2b-4b6b-49bc-90c0-000aeab3cbd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:49.665289 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86cb3b2b-4b6b-49bc-90c0-000aeab3cbd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:49.665988 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86cb3b2b-4b6b-49bc-90c0-000aeab3cbd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:49.666443 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86cb3b2b-4b6b-49bc-90c0-000aeab3cbd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:49.666932 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-86cb3b2b-4b6b-49bc-90c0-000aeab3cbd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:49.796697 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-86cb3b2b-4b6b-49bc-90c0-000aeab3cbd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:49.799008 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:49.805911 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-86cb3b2b-4b6b-49bc-90c0-000aeab3cbd2 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 200 len: 1681 microversion: 2.1 time: 0.153841 Aug 30 05:22:49.806483 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 533/1094] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:49 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:50.827875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a21a5310-c528-442f-b5a1-864491581ccc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:50.828572 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a21a5310-c528-442f-b5a1-864491581ccc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:50.831096 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:50.836348 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a21a5310-c528-442f-b5a1-864491581ccc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:50.836838 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a21a5310-c528-442f-b5a1-864491581ccc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:50.837275 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a21a5310-c528-442f-b5a1-864491581ccc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:50.837971 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a21a5310-c528-442f-b5a1-864491581ccc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:50.838683 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a21a5310-c528-442f-b5a1-864491581ccc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:50.839132 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a21a5310-c528-442f-b5a1-864491581ccc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:50.969793 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a21a5310-c528-442f-b5a1-864491581ccc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:50.977982 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a21a5310-c528-442f-b5a1-864491581ccc tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 200 len: 1681 microversion: 2.1 time: 0.154381 Aug 30 05:22:50.978553 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 562/1095] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:50 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:51.999713 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ee9d1342-68e9-4a58-8ae8-99816dd2a875 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:52.000268 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ee9d1342-68e9-4a58-8ae8-99816dd2a875 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:52.003603 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=27 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:52.014199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee9d1342-68e9-4a58-8ae8-99816dd2a875 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:52.014690 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee9d1342-68e9-4a58-8ae8-99816dd2a875 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:52.015159 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee9d1342-68e9-4a58-8ae8-99816dd2a875 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:52.015866 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee9d1342-68e9-4a58-8ae8-99816dd2a875 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:52.016326 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee9d1342-68e9-4a58-8ae8-99816dd2a875 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:52.016753 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ee9d1342-68e9-4a58-8ae8-99816dd2a875 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:52.228262 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ee9d1342-68e9-4a58-8ae8-99816dd2a875 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd079e0264f0e40db9fc93b8f217a7a74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bebd859c24cd4ed3b7e32a82de820b8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:52.236102 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ee9d1342-68e9-4a58-8ae8-99816dd2a875 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 200 len: 1681 microversion: 2.1 time: 0.240289 Aug 30 05:22:52.237164 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 534/1096] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:51 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:52.637658 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-3cd98e6e-f70c-4368-b7c3-1dfdcd287f41 req-3c043e7a-b7ab-4978-b700-7bd3aaa95adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4f3fcb1-0c37-497e-b603-d8fae3e2048a", "name": "network-vif-deleted", "tag": "3c621d46-c5fc-4ccc-add5-edce4f04d0e0"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:22:52.650112 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-3cd98e6e-f70c-4368-b7c3-1dfdcd287f41 req-3c043e7a-b7ab-4978-b700-7bd3aaa95adb service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:52.651869 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-3cd98e6e-f70c-4368-b7c3-1dfdcd287f41 req-3c043e7a-b7ab-4978-b700-7bd3aaa95adb service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:52.651982 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-3cd98e6e-f70c-4368-b7c3-1dfdcd287f41 req-3c043e7a-b7ab-4978-b700-7bd3aaa95adb service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:52.668681 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-3cd98e6e-f70c-4368-b7c3-1dfdcd287f41 req-3c043e7a-b7ab-4978-b700-7bd3aaa95adb service nova] Creating event network-vif-deleted:3c621d46-c5fc-4ccc-add5-edce4f04d0e0 for instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a on hv-cinder-85391 Aug 30 05:22:52.673637 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-3cd98e6e-f70c-4368-b7c3-1dfdcd287f41 req-3c043e7a-b7ab-4978-b700-7bd3aaa95adb service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190612 Aug 30 05:22:52.675176 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 563/1097] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:22:53.258037 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0e853641-01c0-4ffa-90a6-abcae8b1f10c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:53.258679 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-0e853641-01c0-4ffa-90a6-abcae8b1f10c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:53.265410 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e853641-01c0-4ffa-90a6-abcae8b1f10c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:53.265983 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e853641-01c0-4ffa-90a6-abcae8b1f10c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:53.266485 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e853641-01c0-4ffa-90a6-abcae8b1f10c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:53.267281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e853641-01c0-4ffa-90a6-abcae8b1f10c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:53.267927 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e853641-01c0-4ffa-90a6-abcae8b1f10c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:53.269092 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-0e853641-01c0-4ffa-90a6-abcae8b1f10c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:53.283229 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-0e853641-01c0-4ffa-90a6-abcae8b1f10c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] HTTP exception thrown: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0e853641-01c0-4ffa-90a6-abcae8b1f10c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Request method failure captured: Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a HTTP/1.1 Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZ1_BwqBAvo25XUAt_hPX0zVighjm0QlniWU-jqAI4fG3e31IXufsUyXytncyQcNIsqbFJosPnnVGxtyzcvHCLdS0OGpuhx6w1qakeVZUvmKyNmZ6a2aA0JwLTrTvk1kHTprNY5RT9dfrhFGUO0IJBcYTYeHf_BQhuD-oVr-rD2jMpc Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:22:53.284896 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:22:53.286589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bebd859c24cd4ed3b7e32a82de820b8a", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:22:53.286589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:53.286589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:53.286589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:53.286589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:53.286589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:22:53.286589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:22:53.286589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: d079e0264f0e40db9fc93b8f217a7a74 Aug 30 05:22:53.286589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:53.286589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:22:53.286589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. Aug 30 05:22:53.286589 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': 'e4f3fcb1-0c37-497e-b603-d8fae3e2048a'} Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:22:53.287588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. Aug 30 05:22:53.289144 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:53.290541 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-0e853641-01c0-4ffa-90a6-abcae8b1f10c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Returning 404 to user: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:22:53.290541 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-0e853641-01c0-4ffa-90a6-abcae8b1f10c tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 404 len: 111 microversion: 2.1 time: 0.032139 Aug 30 05:22:53.290541 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 535/1098] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:53 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:22:53.295997 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-876aed2d-f0cf-429d-aab6-9110ffbb4c31 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '.version_select at 0x7f822ef229d0>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:53.315563 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-876aed2d-f0cf-429d-aab6-9110ffbb4c31 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1494234423" status: 202 len: 0 microversion: 2.1 time: 0.022972 Aug 30 05:22:53.316184 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 564/1099] 10.222.0.77 () {58 vars in 1221 bytes} [Tue Aug 30 05:22:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1494234423 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:22:55.049862 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-51aa6878-1601-4b1d-accf-ca418af85c18 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:55.050366 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-51aa6878-1601-4b1d-accf-ca418af85c18 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:55.056232 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51aa6878-1601-4b1d-accf-ca418af85c18 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:55.056718 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51aa6878-1601-4b1d-accf-ca418af85c18 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:55.057152 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51aa6878-1601-4b1d-accf-ca418af85c18 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:55.057844 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51aa6878-1601-4b1d-accf-ca418af85c18 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:55.058299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51aa6878-1601-4b1d-accf-ca418af85c18 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:55.058724 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-51aa6878-1601-4b1d-accf-ca418af85c18 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:55.072615 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-51aa6878-1601-4b1d-accf-ca418af85c18 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] HTTP exception thrown: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-51aa6878-1601-4b1d-accf-ca418af85c18 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Request method failure captured: Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a HTTP/1.1 Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZ1_BwqBAvo25XUAt_hPX0zVighjm0QlniWU-jqAI4fG3e31IXufsUyXytncyQcNIsqbFJosPnnVGxtyzcvHCLdS0OGpuhx6w1qakeVZUvmKyNmZ6a2aA0JwLTrTvk1kHTprNY5RT9dfrhFGUO0IJBcYTYeHf_BQhuD-oVr-rD2jMpc Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:22:55.074142 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:22:55.075766 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bebd859c24cd4ed3b7e32a82de820b8a", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:22:55.075766 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:55.075766 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:55.075766 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:55.075766 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:55.075766 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:22:55.075766 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:22:55.075766 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: d079e0264f0e40db9fc93b8f217a7a74 Aug 30 05:22:55.075766 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:55.075766 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:22:55.075766 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. Aug 30 05:22:55.075766 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': 'e4f3fcb1-0c37-497e-b603-d8fae3e2048a'} Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:22:55.077446 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. Aug 30 05:22:55.078936 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:55.080456 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-51aa6878-1601-4b1d-accf-ca418af85c18 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Returning 404 to user: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:22:55.080456 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-51aa6878-1601-4b1d-accf-ca418af85c18 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "DELETE /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 404 len: 111 microversion: 2.1 time: 0.030528 Aug 30 05:22:55.080456 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 536/1100] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:22:55 2022] DELETE /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:22:55.084024 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d2a18ee3-ce63-4ea0-8bd4-e3bdf535aabf tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:55.084767 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-d2a18ee3-ce63-4ea0-8bd4-e3bdf535aabf tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: e4f3fcb1-0c37-497e-b603-d8fae3e2048a] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:55.092105 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2a18ee3-ce63-4ea0-8bd4-e3bdf535aabf tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:55.092586 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2a18ee3-ce63-4ea0-8bd4-e3bdf535aabf tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:55.093022 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2a18ee3-ce63-4ea0-8bd4-e3bdf535aabf tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:55.093711 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2a18ee3-ce63-4ea0-8bd4-e3bdf535aabf tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:55.094166 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2a18ee3-ce63-4ea0-8bd4-e3bdf535aabf tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:55.094593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-d2a18ee3-ce63-4ea0-8bd4-e3bdf535aabf tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:55.108182 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-d2a18ee3-ce63-4ea0-8bd4-e3bdf535aabf tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] HTTP exception thrown: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d2a18ee3-ce63-4ea0-8bd4-e3bdf535aabf tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Request method failure captured: Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a HTTP/1.1 Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZ1_BwqBAvo25XUAt_hPX0zVighjm0QlniWU-jqAI4fG3e31IXufsUyXytncyQcNIsqbFJosPnnVGxtyzcvHCLdS0OGpuhx6w1qakeVZUvmKyNmZ6a2aA0JwLTrTvk1kHTprNY5RT9dfrhFGUO0IJBcYTYeHf_BQhuD-oVr-rD2jMpc Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:22:55.109809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:22:55.112030 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bebd859c24cd4ed3b7e32a82de820b8a", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:22:55.112030 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:55.112030 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:55.112030 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:55.112030 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:55.112030 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:22:55.112030 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:22:55.112030 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: d079e0264f0e40db9fc93b8f217a7a74 Aug 30 05:22:55.112030 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:55.112030 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:22:55.112030 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. Aug 30 05:22:55.112030 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': 'e4f3fcb1-0c37-497e-b603-d8fae3e2048a'} Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:22:55.112875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. Aug 30 05:22:55.114102 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:55.115255 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-d2a18ee3-ce63-4ea0-8bd4-e3bdf535aabf tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Returning 404 to user: Instance e4f3fcb1-0c37-497e-b603-d8fae3e2048a could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:22:55.115255 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-d2a18ee3-ce63-4ea0-8bd4-e3bdf535aabf tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a" status: 404 len: 111 microversion: 2.1 time: 0.031008 Aug 30 05:22:55.115255 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 565/1101] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:55 2022] GET /compute/v2.1/servers/e4f3fcb1-0c37-497e-b603-d8fae3e2048a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:22:56.244163 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c2bdd1ad-b0e9-4859-9d52-a72c5c3a60e7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:56.244653 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c2bdd1ad-b0e9-4859-9d52-a72c5c3a60e7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:56.251010 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2bdd1ad-b0e9-4859-9d52-a72c5c3a60e7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:56.251496 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2bdd1ad-b0e9-4859-9d52-a72c5c3a60e7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:56.251933 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2bdd1ad-b0e9-4859-9d52-a72c5c3a60e7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:56.253176 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2bdd1ad-b0e9-4859-9d52-a72c5c3a60e7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:56.253630 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2bdd1ad-b0e9-4859-9d52-a72c5c3a60e7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:56.254056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c2bdd1ad-b0e9-4859-9d52-a72c5c3a60e7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:56.267242 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-c2bdd1ad-b0e9-4859-9d52-a72c5c3a60e7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] HTTP exception thrown: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c2bdd1ad-b0e9-4859-9d52-a72c5c3a60e7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Request method failure captured: Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 HTTP/1.1 Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZ1_BwqBAvo25XUAt_hPX0zVighjm0QlniWU-jqAI4fG3e31IXufsUyXytncyQcNIsqbFJosPnnVGxtyzcvHCLdS0OGpuhx6w1qakeVZUvmKyNmZ6a2aA0JwLTrTvk1kHTprNY5RT9dfrhFGUO0IJBcYTYeHf_BQhuD-oVr-rD2jMpc Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:22:56.269376 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:22:56.271063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bebd859c24cd4ed3b7e32a82de820b8a", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:22:56.271063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:56.271063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:56.271063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:56.271063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:56.271063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:22:56.271063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:22:56.271063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: d079e0264f0e40db9fc93b8f217a7a74 Aug 30 05:22:56.271063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:56.271063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:22:56.271063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. Aug 30 05:22:56.271063 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': '609ae0b0-7ae0-4849-b6c0-47a80959c070'} Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:22:56.272153 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. Aug 30 05:22:56.273694 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.275352 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c2bdd1ad-b0e9-4859-9d52-a72c5c3a60e7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Returning 404 to user: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:22:56.275352 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c2bdd1ad-b0e9-4859-9d52-a72c5c3a60e7 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "DELETE /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 404 len: 111 microversion: 2.1 time: 0.030379 Aug 30 05:22:56.275352 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 537/1102] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:22:56 2022] DELETE /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:22:56.279084 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4a571d83-adf2-42e9-a7d3-b27d132f1907 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:56.279699 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-4a571d83-adf2-42e9-a7d3-b27d132f1907 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 609ae0b0-7ae0-4849-b6c0-47a80959c070] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:56.286041 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a571d83-adf2-42e9-a7d3-b27d132f1907 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:56.286516 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a571d83-adf2-42e9-a7d3-b27d132f1907 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:56.286972 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a571d83-adf2-42e9-a7d3-b27d132f1907 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:56.287652 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a571d83-adf2-42e9-a7d3-b27d132f1907 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:56.288098 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a571d83-adf2-42e9-a7d3-b27d132f1907 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:56.288517 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-4a571d83-adf2-42e9-a7d3-b27d132f1907 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:56.301684 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-4a571d83-adf2-42e9-a7d3-b27d132f1907 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] HTTP exception thrown: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4a571d83-adf2-42e9-a7d3-b27d132f1907 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Request method failure captured: Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 HTTP/1.1 Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZ1_BwqBAvo25XUAt_hPX0zVighjm0QlniWU-jqAI4fG3e31IXufsUyXytncyQcNIsqbFJosPnnVGxtyzcvHCLdS0OGpuhx6w1qakeVZUvmKyNmZ6a2aA0JwLTrTvk1kHTprNY5RT9dfrhFGUO0IJBcYTYeHf_BQhuD-oVr-rD2jMpc Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:22:56.303228 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:22:56.304845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bebd859c24cd4ed3b7e32a82de820b8a", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:22:56.304845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:56.304845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:56.304845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:56.304845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:56.304845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:22:56.304845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:22:56.304845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: d079e0264f0e40db9fc93b8f217a7a74 Aug 30 05:22:56.304845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:56.304845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:22:56.304845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. Aug 30 05:22:56.304845 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '609ae0b0-7ae0-4849-b6c0-47a80959c070'} Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:22:56.305714 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. Aug 30 05:22:56.307195 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.308517 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-4a571d83-adf2-42e9-a7d3-b27d132f1907 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Returning 404 to user: Instance 609ae0b0-7ae0-4849-b6c0-47a80959c070 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:22:56.308517 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-4a571d83-adf2-42e9-a7d3-b27d132f1907 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070" status: 404 len: 111 microversion: 2.1 time: 0.029356 Aug 30 05:22:56.308517 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 566/1103] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:56 2022] GET /compute/v2.1/servers/609ae0b0-7ae0-4849-b6c0-47a80959c070 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:22:56.312630 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b5bb099e-7c38-4bdf-96e7-781ac5b899f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:56.313131 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b5bb099e-7c38-4bdf-96e7-781ac5b899f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:56.319549 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5bb099e-7c38-4bdf-96e7-781ac5b899f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:56.320033 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5bb099e-7c38-4bdf-96e7-781ac5b899f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:56.320471 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5bb099e-7c38-4bdf-96e7-781ac5b899f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:56.321165 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5bb099e-7c38-4bdf-96e7-781ac5b899f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:56.321627 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5bb099e-7c38-4bdf-96e7-781ac5b899f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:56.322054 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b5bb099e-7c38-4bdf-96e7-781ac5b899f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:56.335959 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-b5bb099e-7c38-4bdf-96e7-781ac5b899f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] HTTP exception thrown: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b5bb099e-7c38-4bdf-96e7-781ac5b899f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Request method failure captured: Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 HTTP/1.1 Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZ1_BwqBAvo25XUAt_hPX0zVighjm0QlniWU-jqAI4fG3e31IXufsUyXytncyQcNIsqbFJosPnnVGxtyzcvHCLdS0OGpuhx6w1qakeVZUvmKyNmZ6a2aA0JwLTrTvk1kHTprNY5RT9dfrhFGUO0IJBcYTYeHf_BQhuD-oVr-rD2jMpc Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:22:56.337479 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:22:56.339289 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bebd859c24cd4ed3b7e32a82de820b8a", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:22:56.339289 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:56.339289 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:56.339289 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:56.339289 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:56.339289 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:22:56.339289 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:22:56.339289 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: d079e0264f0e40db9fc93b8f217a7a74 Aug 30 05:22:56.339289 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:56.339289 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:22:56.339289 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. Aug 30 05:22:56.339289 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': '4766e8f6-4e42-4773-bb22-b725770d2487'} Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:22:56.340174 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. Aug 30 05:22:56.341631 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.343272 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b5bb099e-7c38-4bdf-96e7-781ac5b899f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Returning 404 to user: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:22:56.343272 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b5bb099e-7c38-4bdf-96e7-781ac5b899f6 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "DELETE /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 404 len: 111 microversion: 2.1 time: 0.030229 Aug 30 05:22:56.343272 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 538/1104] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:22:56 2022] DELETE /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:22:56.347499 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b891752-45a4-4826-896c-2cf01f4aa082 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:56.348123 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-8b891752-45a4-4826-896c-2cf01f4aa082 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: 4766e8f6-4e42-4773-bb22-b725770d2487] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:56.354282 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b891752-45a4-4826-896c-2cf01f4aa082 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:56.354612 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b891752-45a4-4826-896c-2cf01f4aa082 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:56.355084 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b891752-45a4-4826-896c-2cf01f4aa082 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:56.355790 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b891752-45a4-4826-896c-2cf01f4aa082 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:56.356247 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b891752-45a4-4826-896c-2cf01f4aa082 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:56.356675 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-8b891752-45a4-4826-896c-2cf01f4aa082 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:56.370176 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-8b891752-45a4-4826-896c-2cf01f4aa082 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] HTTP exception thrown: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b891752-45a4-4826-896c-2cf01f4aa082 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Request method failure captured: Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 HTTP/1.1 Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZ1_BwqBAvo25XUAt_hPX0zVighjm0QlniWU-jqAI4fG3e31IXufsUyXytncyQcNIsqbFJosPnnVGxtyzcvHCLdS0OGpuhx6w1qakeVZUvmKyNmZ6a2aA0JwLTrTvk1kHTprNY5RT9dfrhFGUO0IJBcYTYeHf_BQhuD-oVr-rD2jMpc Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:22:56.371729 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:22:56.373315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bebd859c24cd4ed3b7e32a82de820b8a", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:22:56.373315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:56.373315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:56.373315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:56.373315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:56.373315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:22:56.373315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:22:56.373315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: d079e0264f0e40db9fc93b8f217a7a74 Aug 30 05:22:56.373315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:56.373315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:22:56.373315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. Aug 30 05:22:56.373315 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': '4766e8f6-4e42-4773-bb22-b725770d2487'} Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:22:56.374194 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. Aug 30 05:22:56.375749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:56.377032 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-8b891752-45a4-4826-896c-2cf01f4aa082 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Returning 404 to user: Instance 4766e8f6-4e42-4773-bb22-b725770d2487 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:22:56.377032 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-8b891752-45a4-4826-896c-2cf01f4aa082 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487" status: 404 len: 111 microversion: 2.1 time: 0.029476 Aug 30 05:22:56.377032 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 567/1105] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:56 2022] GET /compute/v2.1/servers/4766e8f6-4e42-4773-bb22-b725770d2487 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:22:57.510711 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a367e147-a619-45ef-8642-049c4b35e01a tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:57.511240 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-a367e147-a619-45ef-8642-049c4b35e01a tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:57.517536 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a367e147-a619-45ef-8642-049c4b35e01a tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:57.518514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a367e147-a619-45ef-8642-049c4b35e01a tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:57.518981 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a367e147-a619-45ef-8642-049c4b35e01a tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:57.519673 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a367e147-a619-45ef-8642-049c4b35e01a tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:57.520129 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a367e147-a619-45ef-8642-049c4b35e01a tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:57.520555 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-a367e147-a619-45ef-8642-049c4b35e01a tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:57.534510 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.wsgi [None req-a367e147-a619-45ef-8642-049c4b35e01a tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] HTTP exception thrown: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a367e147-a619-45ef-8642-049c4b35e01a tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Request method failure captured: Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: request: DELETE /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 HTTP/1.1 Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept: application/json Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Accept-Encoding: identity Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Connection: close Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Length: 0 Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Content-Type: application/json Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Host: 10.222.0.77 Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Openstack-System-Scope: None Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: User-Agent: python-urllib3/1.26.12 Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Auth-Token: gAAAAABjDZ1_BwqBAvo25XUAt_hPX0zVighjm0QlniWU-jqAI4fG3e31IXufsUyXytncyQcNIsqbFJosPnnVGxtyzcvHCLdS0OGpuhx6w1qakeVZUvmKyNmZ6a2aA0JwLTrTvk1kHTprNY5RT9dfrhFGUO0IJBcYTYeHf_BQhuD-oVr-rD2jMpc Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Id: None Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Domain-Name: None Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Identity-Status: Confirmed Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Is-Admin-Project: True Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Id: default Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Domain-Name: Default Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Role: reader,member Aug 30 05:22:57.536111 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Roles: reader,member Aug 30 05:22:57.538480 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bebd859c24cd4ed3b7e32a82de820b8a", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:22:57.538480 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:57.538480 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:57.538480 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:57.538480 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:57.538480 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Id: default Aug 30 05:22:57.538480 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Domain-Name: Default Aug 30 05:22:57.538480 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Id: d079e0264f0e40db9fc93b8f217a7a74 Aug 30 05:22:57.538480 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: X-User-Name: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:57.538480 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: method: > Aug 30 05:22:57.538480 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: exception: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. Aug 30 05:22:57.538480 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: action_args: {'id': 'cd7486a8-b5d7-45e0-921a-6621d9a10233'} Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:22:57.539849 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. Aug 30 05:22:57.542299 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR nova.api.openstack.wsgi Aug 30 05:22:57.545048 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-a367e147-a619-45ef-8642-049c4b35e01a tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Returning 404 to user: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. {{(pid=120573) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:22:57.545048 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-a367e147-a619-45ef-8642-049c4b35e01a tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "DELETE /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 404 len: 111 microversion: 2.1 time: 0.030576 Aug 30 05:22:57.545048 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 539/1106] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:22:57 2022] DELETE /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:22:57.547659 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5c08c6b8-83dd-48b8-b8ff-678947a3d178 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:57.548272 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-5c08c6b8-83dd-48b8-b8ff-678947a3d178 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] [instance: cd7486a8-b5d7-45e0-921a-6621d9a10233] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:57.554234 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c08c6b8-83dd-48b8-b8ff-678947a3d178 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:57.554710 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c08c6b8-83dd-48b8-b8ff-678947a3d178 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:57.555174 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c08c6b8-83dd-48b8-b8ff-678947a3d178 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:57.555857 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c08c6b8-83dd-48b8-b8ff-678947a3d178 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:57.556306 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c08c6b8-83dd-48b8-b8ff-678947a3d178 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:57.556724 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-5c08c6b8-83dd-48b8-b8ff-678947a3d178 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:57.570515 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-5c08c6b8-83dd-48b8-b8ff-678947a3d178 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] HTTP exception thrown: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5c08c6b8-83dd-48b8-b8ff-678947a3d178 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Request method failure captured: Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 HTTP/1.1 Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZ1_BwqBAvo25XUAt_hPX0zVighjm0QlniWU-jqAI4fG3e31IXufsUyXytncyQcNIsqbFJosPnnVGxtyzcvHCLdS0OGpuhx6w1qakeVZUvmKyNmZ6a2aA0JwLTrTvk1kHTprNY5RT9dfrhFGUO0IJBcYTYeHf_BQhuD-oVr-rD2jMpc Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:22:57.572025 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:22:57.573720 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/bebd859c24cd4ed3b7e32a82de820b8a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_bebd859c24cd4ed3b7e32a82de820b8a", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:22:57.573720 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:57.573720 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: bebd859c24cd4ed3b7e32a82de820b8a Aug 30 05:22:57.573720 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1311861976 Aug 30 05:22:57.573720 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:57.573720 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:22:57.573720 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:22:57.573720 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: d079e0264f0e40db9fc93b8f217a7a74 Aug 30 05:22:57.573720 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-AttachVolumeNegativeTest-1311861976-project Aug 30 05:22:57.573720 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:22:57.573720 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. Aug 30 05:22:57.573720 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': 'cd7486a8-b5d7-45e0-921a-6621d9a10233'} Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:22:57.574651 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. Aug 30 05:22:57.576171 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:22:57.577501 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-5c08c6b8-83dd-48b8-b8ff-678947a3d178 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] Returning 404 to user: Instance cd7486a8-b5d7-45e0-921a-6621d9a10233 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:22:57.577501 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-5c08c6b8-83dd-48b8-b8ff-678947a3d178 tempest-AttachVolumeNegativeTest-1311861976 tempest-AttachVolumeNegativeTest-1311861976-project] 10.222.0.77 "GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233" status: 404 len: 111 microversion: 2.1 time: 0.031087 Aug 30 05:22:57.577501 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 568/1107] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:57 2022] GET /compute/v2.1/servers/cd7486a8-b5d7-45e0-921a-6621d9a10233 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:23:46.866796 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=11 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:23:46.867687 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=17 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:23:47.036399 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-bc246810-db15-4e2b-a5df-72aad04b5625 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Action: 'create', calling method: .version_select at 0x7f822ec99e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-823395391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFFj5HR8d6Wg24WxNgV4uDcyLNGP2xCeLz0LOgMAbpqBeo0eSBPchbWw9yfzACr6cnZQl8MH3MoHoyEo2YRKGncNNzKf5yiHnX4jcAmog19wdhugpCZHY1iA+2U1HK5Aw=="}} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:23:47.053803 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-bc246810-db15-4e2b-a5df-72aad04b5625 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Getting quotas for project 05ebb49967334f8bb6f2077fce987ee3. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:23:47.057761 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.quota [None req-bc246810-db15-4e2b-a5df-72aad04b5625 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Getting quotas for user 8f9b73d97e8145a39215f179b1398350 and project 05ebb49967334f8bb6f2077fce987ee3. Resources: {'key_pairs'} {{(pid=120573) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:23:47.081436 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-bc246810-db15-4e2b-a5df-72aad04b5625 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.219407 Aug 30 05:23:47.082071 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 540/1108] 10.222.0.77 () {60 vars in 1159 bytes} [Tue Aug 30 05:23:46 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:24:04.326060 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:04.326837 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:04.331110 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1094716310", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-823395391", "security_groups": [{"name": "tempest-secgroup-smoke-825295871"}], "networks": [{"uuid": "575e8862-a739-480a-b02b-b93764068dd4"}], "block_device_mapping_v2": [{"uuid": "a4c96e5d-adb4-42f3-be52-73e44bd2a7f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:24:04.444046 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.network.neutron [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] validate_networks() for [('575e8862-a739-480a-b02b-b93764068dd4', None, None, None, None, None)] {{(pid=120572) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 05:24:04.906166 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Flavor limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:24:04.906586 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Image limits 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:24:04.907100 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Flavor pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:24:04.907537 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Image pref 0:0:0 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:24:04.907945 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.virt.hardware [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120572) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:24:04.918072 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:04.918569 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:04.919038 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:04.919756 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:04.920204 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:04.920619 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:04.936691 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Getting quotas for project 05ebb49967334f8bb6f2077fce987ee3. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:24:04.940591 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.quota [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Getting quotas for user 8f9b73d97e8145a39215f179b1398350 and project 05ebb49967334f8bb6f2077fce987ee3. Resources: {'instances', 'ram', 'cores'} {{(pid=120572) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:24:04.996029 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Going to run 1 instances... {{(pid=120572) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:24:04.998175 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a4c96e5d-adb4-42f3-be52-73e44bd2a7f6',volume_size=None,volume_type=None)] {{(pid=120572) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:24:05.123156 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b58a470a-ab05-4207-9867-f220526597b0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.798824 Aug 30 05:24:05.123793 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 569/1109] 10.222.0.77 () {60 vars in 1147 bytes} [Tue Aug 30 05:24:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:24:05.132787 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=4 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:05.133608 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:05.134714 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:24:05.134954 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Tue Aug 30 05:24:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 (ip 10.222.0.77) !!! Aug 30 05:24:05.142656 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-659b4789-aaac-4e55-852e-c32b712616c9 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:05.143296 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-659b4789-aaac-4e55-852e-c32b712616c9 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:05.199650 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-659b4789-aaac-4e55-852e-c32b712616c9 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:05.206668 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-659b4789-aaac-4e55-852e-c32b712616c9 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1088 microversion: 2.1 time: 0.075948 Aug 30 05:24:05.207266 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 541/1110] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:05 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:06.228130 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-66024dad-7f60-43b8-b8e9-f9ab272ff7a0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:06.228820 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-66024dad-7f60-43b8-b8e9-f9ab272ff7a0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:06.236545 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66024dad-7f60-43b8-b8e9-f9ab272ff7a0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:06.237089 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66024dad-7f60-43b8-b8e9-f9ab272ff7a0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:06.237530 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66024dad-7f60-43b8-b8e9-f9ab272ff7a0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:06.238233 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66024dad-7f60-43b8-b8e9-f9ab272ff7a0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:06.238703 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66024dad-7f60-43b8-b8e9-f9ab272ff7a0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:06.239347 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-66024dad-7f60-43b8-b8e9-f9ab272ff7a0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:06.304634 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-66024dad-7f60-43b8-b8e9-f9ab272ff7a0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:06.312329 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-66024dad-7f60-43b8-b8e9-f9ab272ff7a0 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1194 microversion: 2.1 time: 0.089129 Aug 30 05:24:06.312897 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 570/1111] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:06 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:07.333126 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-943e77c3-4b45-4357-9f3c-2d2980ffec2b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:07.334862 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-943e77c3-4b45-4357-9f3c-2d2980ffec2b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:07.341717 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-943e77c3-4b45-4357-9f3c-2d2980ffec2b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:07.342207 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-943e77c3-4b45-4357-9f3c-2d2980ffec2b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:07.342643 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-943e77c3-4b45-4357-9f3c-2d2980ffec2b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:07.343375 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-943e77c3-4b45-4357-9f3c-2d2980ffec2b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:07.343833 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-943e77c3-4b45-4357-9f3c-2d2980ffec2b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:07.344263 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-943e77c3-4b45-4357-9f3c-2d2980ffec2b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:07.568269 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-943e77c3-4b45-4357-9f3c-2d2980ffec2b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:07.576700 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-943e77c3-4b45-4357-9f3c-2d2980ffec2b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1259 microversion: 2.1 time: 0.247415 Aug 30 05:24:07.577273 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 542/1112] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:07 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1259 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:07.680162 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-44a1e929-bae5-4a56-886c-c8948a435ab8 req-c7345b8e-2fb5-4aac-9fb1-d9204859285c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc43249b-bc0f-4793-8d59-92e51dbedcd8", "tag": "28cd9f07-60ec-4528-9911-a8bd30f4567a"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:24:07.690288 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-44a1e929-bae5-4a56-886c-c8948a435ab8 req-c7345b8e-2fb5-4aac-9fb1-d9204859285c service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:07.690793 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-44a1e929-bae5-4a56-886c-c8948a435ab8 req-c7345b8e-2fb5-4aac-9fb1-d9204859285c service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:07.691244 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-44a1e929-bae5-4a56-886c-c8948a435ab8 req-c7345b8e-2fb5-4aac-9fb1-d9204859285c service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:07.704889 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-44a1e929-bae5-4a56-886c-c8948a435ab8 req-c7345b8e-2fb5-4aac-9fb1-d9204859285c service nova] Creating event network-changed:28cd9f07-60ec-4528-9911-a8bd30f4567a for instance cc43249b-bc0f-4793-8d59-92e51dbedcd8 on hv-cinder-85391 Aug 30 05:24:07.710162 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-44a1e929-bae5-4a56-886c-c8948a435ab8 req-c7345b8e-2fb5-4aac-9fb1-d9204859285c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035475 Aug 30 05:24:07.710961 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 571/1113] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:24:08.597499 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4f587d4a-1298-40ac-ab37-20d863425f5a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:08.598101 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4f587d4a-1298-40ac-ab37-20d863425f5a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:08.604963 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4f587d4a-1298-40ac-ab37-20d863425f5a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:08.605447 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4f587d4a-1298-40ac-ab37-20d863425f5a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:08.605879 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4f587d4a-1298-40ac-ab37-20d863425f5a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:08.606571 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4f587d4a-1298-40ac-ab37-20d863425f5a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:08.607059 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4f587d4a-1298-40ac-ab37-20d863425f5a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:08.607490 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4f587d4a-1298-40ac-ab37-20d863425f5a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:08.808760 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-4f587d4a-1298-40ac-ab37-20d863425f5a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:08.816328 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4f587d4a-1298-40ac-ab37-20d863425f5a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1259 microversion: 2.1 time: 0.222705 Aug 30 05:24:08.816894 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 543/1114] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:08 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:09.839139 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-9771a696-7b3c-4937-b982-db370bd0d25c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:09.839839 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-9771a696-7b3c-4937-b982-db370bd0d25c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:09.846057 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9771a696-7b3c-4937-b982-db370bd0d25c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:09.846535 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9771a696-7b3c-4937-b982-db370bd0d25c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:09.847001 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9771a696-7b3c-4937-b982-db370bd0d25c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:09.847683 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9771a696-7b3c-4937-b982-db370bd0d25c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:09.848137 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9771a696-7b3c-4937-b982-db370bd0d25c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:09.848559 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-9771a696-7b3c-4937-b982-db370bd0d25c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:09.982548 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-9771a696-7b3c-4937-b982-db370bd0d25c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:09.990199 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-9771a696-7b3c-4937-b982-db370bd0d25c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1259 microversion: 2.1 time: 0.156841 Aug 30 05:24:09.990809 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 572/1115] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:09 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:11.012282 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c8c7e646-2cb6-4fbe-b2fe-aaf1e38b247e tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:11.012897 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c8c7e646-2cb6-4fbe-b2fe-aaf1e38b247e tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:11.019247 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c8c7e646-2cb6-4fbe-b2fe-aaf1e38b247e tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:11.019737 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c8c7e646-2cb6-4fbe-b2fe-aaf1e38b247e tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:11.020175 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c8c7e646-2cb6-4fbe-b2fe-aaf1e38b247e tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:11.020871 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c8c7e646-2cb6-4fbe-b2fe-aaf1e38b247e tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:11.021331 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c8c7e646-2cb6-4fbe-b2fe-aaf1e38b247e tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:11.021845 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c8c7e646-2cb6-4fbe-b2fe-aaf1e38b247e tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:11.418202 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c8c7e646-2cb6-4fbe-b2fe-aaf1e38b247e tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:11.425832 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c8c7e646-2cb6-4fbe-b2fe-aaf1e38b247e tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1259 microversion: 2.1 time: 0.417420 Aug 30 05:24:11.426401 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 544/1116] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:11 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1259 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:24:12.447144 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ac95fdd6-d8f1-4569-b5a4-0fbfba105703 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:12.447781 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ac95fdd6-d8f1-4569-b5a4-0fbfba105703 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:12.454116 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac95fdd6-d8f1-4569-b5a4-0fbfba105703 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:12.454593 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac95fdd6-d8f1-4569-b5a4-0fbfba105703 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:12.455054 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac95fdd6-d8f1-4569-b5a4-0fbfba105703 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:12.455743 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac95fdd6-d8f1-4569-b5a4-0fbfba105703 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:12.456192 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac95fdd6-d8f1-4569-b5a4-0fbfba105703 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:12.456615 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ac95fdd6-d8f1-4569-b5a4-0fbfba105703 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:12.583781 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-ac95fdd6-d8f1-4569-b5a4-0fbfba105703 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:12.592122 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ac95fdd6-d8f1-4569-b5a4-0fbfba105703 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1259 microversion: 2.1 time: 0.149341 Aug 30 05:24:12.592682 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 573/1117] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:12 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:13.612355 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1deb0ad6-c15e-41c9-ab24-e7a203d4b5ff tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:13.612999 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1deb0ad6-c15e-41c9-ab24-e7a203d4b5ff tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:13.619323 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1deb0ad6-c15e-41c9-ab24-e7a203d4b5ff tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:13.619808 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1deb0ad6-c15e-41c9-ab24-e7a203d4b5ff tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:13.620243 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1deb0ad6-c15e-41c9-ab24-e7a203d4b5ff tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:13.620934 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1deb0ad6-c15e-41c9-ab24-e7a203d4b5ff tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:13.621388 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1deb0ad6-c15e-41c9-ab24-e7a203d4b5ff tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:13.621816 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1deb0ad6-c15e-41c9-ab24-e7a203d4b5ff tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:13.751811 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1deb0ad6-c15e-41c9-ab24-e7a203d4b5ff tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:13.759519 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1deb0ad6-c15e-41c9-ab24-e7a203d4b5ff tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1259 microversion: 2.1 time: 0.151083 Aug 30 05:24:13.760079 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 545/1118] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:13 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:14.779555 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c124e59b-40f9-458b-b670-b84bc7062e6a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:14.780120 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c124e59b-40f9-458b-b670-b84bc7062e6a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:14.786646 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c124e59b-40f9-458b-b670-b84bc7062e6a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:14.787163 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c124e59b-40f9-458b-b670-b84bc7062e6a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:14.787597 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c124e59b-40f9-458b-b670-b84bc7062e6a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:14.788282 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c124e59b-40f9-458b-b670-b84bc7062e6a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:14.789224 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c124e59b-40f9-458b-b670-b84bc7062e6a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:14.789644 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c124e59b-40f9-458b-b670-b84bc7062e6a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:14.920353 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c124e59b-40f9-458b-b670-b84bc7062e6a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:14.927953 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c124e59b-40f9-458b-b670-b84bc7062e6a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1259 microversion: 2.1 time: 0.152306 Aug 30 05:24:14.928514 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 574/1119] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:14 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:15.948912 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c6bec894-8519-428a-8c86-a047784bd1b4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:15.949529 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c6bec894-8519-428a-8c86-a047784bd1b4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:15.951925 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell0:SELECT=2 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:15.957439 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6bec894-8519-428a-8c86-a047784bd1b4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:15.957928 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6bec894-8519-428a-8c86-a047784bd1b4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:15.958395 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6bec894-8519-428a-8c86-a047784bd1b4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:15.959146 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6bec894-8519-428a-8c86-a047784bd1b4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:15.959603 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6bec894-8519-428a-8c86-a047784bd1b4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:15.960069 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c6bec894-8519-428a-8c86-a047784bd1b4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:16.090168 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c6bec894-8519-428a-8c86-a047784bd1b4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:16.097680 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c6bec894-8519-428a-8c86-a047784bd1b4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1259 microversion: 2.1 time: 0.153191 Aug 30 05:24:16.098250 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 546/1120] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:15 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:17.117587 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1f9456fb-f7fe-412d-b5ab-8a6466270912 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:17.118239 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1f9456fb-f7fe-412d-b5ab-8a6466270912 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:17.120227 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:17.120885 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell0:SELECT=6 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:17.127848 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f9456fb-f7fe-412d-b5ab-8a6466270912 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:17.128340 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f9456fb-f7fe-412d-b5ab-8a6466270912 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:17.128780 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f9456fb-f7fe-412d-b5ab-8a6466270912 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:17.129485 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f9456fb-f7fe-412d-b5ab-8a6466270912 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:17.129940 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f9456fb-f7fe-412d-b5ab-8a6466270912 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:17.130369 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1f9456fb-f7fe-412d-b5ab-8a6466270912 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:17.261795 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1f9456fb-f7fe-412d-b5ab-8a6466270912 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:17.269633 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1f9456fb-f7fe-412d-b5ab-8a6466270912 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1259 microversion: 2.1 time: 0.155925 Aug 30 05:24:17.270206 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 575/1121] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:17 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:18.291170 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-47ddd751-9262-4b5b-a00d-fea076a276f9 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:18.291786 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-47ddd751-9262-4b5b-a00d-fea076a276f9 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:18.298095 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47ddd751-9262-4b5b-a00d-fea076a276f9 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:18.298580 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47ddd751-9262-4b5b-a00d-fea076a276f9 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:18.299058 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47ddd751-9262-4b5b-a00d-fea076a276f9 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:18.299747 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47ddd751-9262-4b5b-a00d-fea076a276f9 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:18.300199 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47ddd751-9262-4b5b-a00d-fea076a276f9 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:18.300619 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-47ddd751-9262-4b5b-a00d-fea076a276f9 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:18.426294 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-47ddd751-9262-4b5b-a00d-fea076a276f9 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:18.433812 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-47ddd751-9262-4b5b-a00d-fea076a276f9 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1259 microversion: 2.1 time: 0.147106 Aug 30 05:24:18.434373 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 547/1122] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:18 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:18.876631 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-0681e763-150a-4d33-817f-e68482f3e758 req-4a7879cf-e448-4b7c-bfc3-f442e3e03beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc43249b-bc0f-4793-8d59-92e51dbedcd8", "name": "network-vif-plugged", "status": "completed", "tag": "28cd9f07-60ec-4528-9911-a8bd30f4567a"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:24:18.886573 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-0681e763-150a-4d33-817f-e68482f3e758 req-4a7879cf-e448-4b7c-bfc3-f442e3e03beb service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:18.887093 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-0681e763-150a-4d33-817f-e68482f3e758 req-4a7879cf-e448-4b7c-bfc3-f442e3e03beb service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:18.887533 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-0681e763-150a-4d33-817f-e68482f3e758 req-4a7879cf-e448-4b7c-bfc3-f442e3e03beb service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:18.898089 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-0681e763-150a-4d33-817f-e68482f3e758 req-4a7879cf-e448-4b7c-bfc3-f442e3e03beb service nova] Creating event network-vif-plugged:28cd9f07-60ec-4528-9911-a8bd30f4567a for instance cc43249b-bc0f-4793-8d59-92e51dbedcd8 on hv-cinder-85391 Aug 30 05:24:18.903006 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-0681e763-150a-4d33-817f-e68482f3e758 req-4a7879cf-e448-4b7c-bfc3-f442e3e03beb service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094610 Aug 30 05:24:18.903582 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 576/1123] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:24:19.453915 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b861fd48-4bec-4d3e-8f6f-8ca30fcb87a8 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:19.454468 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-b861fd48-4bec-4d3e-8f6f-8ca30fcb87a8 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:19.460911 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b861fd48-4bec-4d3e-8f6f-8ca30fcb87a8 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:19.461391 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b861fd48-4bec-4d3e-8f6f-8ca30fcb87a8 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:19.461823 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b861fd48-4bec-4d3e-8f6f-8ca30fcb87a8 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:19.462514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b861fd48-4bec-4d3e-8f6f-8ca30fcb87a8 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:19.462995 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b861fd48-4bec-4d3e-8f6f-8ca30fcb87a8 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:19.463672 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-b861fd48-4bec-4d3e-8f6f-8ca30fcb87a8 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:19.593928 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-b861fd48-4bec-4d3e-8f6f-8ca30fcb87a8 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:19.602140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b861fd48-4bec-4d3e-8f6f-8ca30fcb87a8 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1259 microversion: 2.1 time: 0.151554 Aug 30 05:24:19.602711 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 548/1124] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:19 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:20.623382 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a0d0e1f6-a970-4e06-99f1-f91208a53a64 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:20.624072 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a0d0e1f6-a970-4e06-99f1-f91208a53a64 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:20.630054 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d0e1f6-a970-4e06-99f1-f91208a53a64 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:20.630526 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d0e1f6-a970-4e06-99f1-f91208a53a64 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:20.630981 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d0e1f6-a970-4e06-99f1-f91208a53a64 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:20.631666 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d0e1f6-a970-4e06-99f1-f91208a53a64 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:20.632111 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d0e1f6-a970-4e06-99f1-f91208a53a64 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:20.633181 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a0d0e1f6-a970-4e06-99f1-f91208a53a64 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:20.767011 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-a0d0e1f6-a970-4e06-99f1-f91208a53a64 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:20.774550 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a0d0e1f6-a970-4e06-99f1-f91208a53a64 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1259 microversion: 2.1 time: 0.155942 Aug 30 05:24:20.775149 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 577/1125] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:20 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:24:21.801321 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-f0cb886b-d545-4b3f-b85d-6f7e0f21d409 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:21.801924 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-f0cb886b-d545-4b3f-b85d-6f7e0f21d409 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:21.808995 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cb886b-d545-4b3f-b85d-6f7e0f21d409 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:21.809478 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cb886b-d545-4b3f-b85d-6f7e0f21d409 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:21.809909 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cb886b-d545-4b3f-b85d-6f7e0f21d409 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:21.810593 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cb886b-d545-4b3f-b85d-6f7e0f21d409 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:21.811070 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cb886b-d545-4b3f-b85d-6f7e0f21d409 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:21.811496 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-f0cb886b-d545-4b3f-b85d-6f7e0f21d409 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:21.937737 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-f0cb886b-d545-4b3f-b85d-6f7e0f21d409 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:21.946231 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-f0cb886b-d545-4b3f-b85d-6f7e0f21d409 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1443 microversion: 2.1 time: 0.148783 Aug 30 05:24:21.946802 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 549/1126] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:21 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:21.966268 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-e1b5b069-9951-4d29-b4fe-bddfcb7e5e60 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:21.966940 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-e1b5b069-9951-4d29-b4fe-bddfcb7e5e60 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:21.973409 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1b5b069-9951-4d29-b4fe-bddfcb7e5e60 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:21.973888 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1b5b069-9951-4d29-b4fe-bddfcb7e5e60 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:21.974322 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1b5b069-9951-4d29-b4fe-bddfcb7e5e60 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:21.975070 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1b5b069-9951-4d29-b4fe-bddfcb7e5e60 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:21.975526 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1b5b069-9951-4d29-b4fe-bddfcb7e5e60 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:21.975949 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-e1b5b069-9951-4d29-b4fe-bddfcb7e5e60 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:22.109559 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-e1b5b069-9951-4d29-b4fe-bddfcb7e5e60 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:22.117742 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-e1b5b069-9951-4d29-b4fe-bddfcb7e5e60 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1443 microversion: 2.1 time: 0.155567 Aug 30 05:24:22.118307 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 578/1127] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:21 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:23.680453 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [req-c3323299-348f-478b-85a5-0f6de073e125 req-af927830-f592-40eb-b86c-a03e1b76a5ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc43249b-bc0f-4793-8d59-92e51dbedcd8", "tag": "28cd9f07-60ec-4528-9911-a8bd30f4567a"}]} {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:24:23.690189 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c3323299-348f-478b-85a5-0f6de073e125 req-af927830-f592-40eb-b86c-a03e1b76a5ab service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:23.690661 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c3323299-348f-478b-85a5-0f6de073e125 req-af927830-f592-40eb-b86c-a03e1b76a5ab service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:23.691114 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [req-c3323299-348f-478b-85a5-0f6de073e125 req-af927830-f592-40eb-b86c-a03e1b76a5ab service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:23.701756 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.compute.server_external_events [req-c3323299-348f-478b-85a5-0f6de073e125 req-af927830-f592-40eb-b86c-a03e1b76a5ab service nova] Creating event network-changed:28cd9f07-60ec-4528-9911-a8bd30f4567a for instance cc43249b-bc0f-4793-8d59-92e51dbedcd8 on hv-cinder-85391 Aug 30 05:24:23.706991 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [req-c3323299-348f-478b-85a5-0f6de073e125 req-af927830-f592-40eb-b86c-a03e1b76a5ab service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030616 Aug 30 05:24:23.707670 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 550/1128] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:26:19.961761 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:19.962509 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=48 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:19.964234 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:26:19.964401 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Tue Aug 30 05:26:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8/action (ip 10.222.0.77) !!! Aug 30 05:26:19.965711 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:26:19.965839 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Tue Aug 30 05:26:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8/action (ip 10.222.0.77) !!! Aug 30 05:26:19.971379 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-ae346a28-2183-4294-938b-f2ff0ba65166 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:26:19.971917 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-ae346a28-2183-4294-938b-f2ff0ba65166 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:19.981766 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae346a28-2183-4294-938b-f2ff0ba65166 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:19.982250 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae346a28-2183-4294-938b-f2ff0ba65166 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:19.982686 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae346a28-2183-4294-938b-f2ff0ba65166 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:19.983411 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae346a28-2183-4294-938b-f2ff0ba65166 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:19.983867 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae346a28-2183-4294-938b-f2ff0ba65166 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:19.984299 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-ae346a28-2183-4294-938b-f2ff0ba65166 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:20.009932 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.objects.instance [None req-ae346a28-2183-4294-938b-f2ff0ba65166 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lazy-loading 'flavor' on Instance uuid cc43249b-bc0f-4793-8d59-92e51dbedcd8 {{(pid=120572) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 05:26:20.079675 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-ae346a28-2183-4294-938b-f2ff0ba65166 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "POST /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8/action" status: 202 len: 0 microversion: 2.1 time: 0.120241 Aug 30 05:26:20.080248 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 579/1129] 10.222.0.77 () {60 vars in 1278 bytes} [Tue Aug 30 05:26:19 2022] POST /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:26:20.087355 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff698d07-c586-4e23-8129-96262633fd1c] AMQP server on 10.222.0.77:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 05:26:20.087954 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=22 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:20.089281 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=50 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:20.089940 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:26:20.090109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Tue Aug 30 05:26:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 (ip 10.222.0.77) !!! Aug 30 05:26:20.096820 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-346edb58-46ff-4c61-a22d-587f9bfd0d94 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:20.097524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-346edb58-46ff-4c61-a22d-587f9bfd0d94 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:20.106583 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-346edb58-46ff-4c61-a22d-587f9bfd0d94 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:20.107110 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-346edb58-46ff-4c61-a22d-587f9bfd0d94 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:20.107575 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-346edb58-46ff-4c61-a22d-587f9bfd0d94 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:20.108287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-346edb58-46ff-4c61-a22d-587f9bfd0d94 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:20.108727 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-346edb58-46ff-4c61-a22d-587f9bfd0d94 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:20.109347 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-346edb58-46ff-4c61-a22d-587f9bfd0d94 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:20.239314 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-346edb58-46ff-4c61-a22d-587f9bfd0d94 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:20.247091 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-346edb58-46ff-4c61-a22d-587f9bfd0d94 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1568 microversion: 2.1 time: 0.162162 Aug 30 05:26:20.247655 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 551/1130] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:20 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:26:21.269499 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f204349b-2d8f-41b6-81a4-723a5aba5fc1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:21.270188 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f204349b-2d8f-41b6-81a4-723a5aba5fc1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:21.276338 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f204349b-2d8f-41b6-81a4-723a5aba5fc1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:21.276818 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f204349b-2d8f-41b6-81a4-723a5aba5fc1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:21.277245 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f204349b-2d8f-41b6-81a4-723a5aba5fc1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:21.277925 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f204349b-2d8f-41b6-81a4-723a5aba5fc1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:21.278373 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f204349b-2d8f-41b6-81a4-723a5aba5fc1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:21.278789 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f204349b-2d8f-41b6-81a4-723a5aba5fc1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:21.407261 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f204349b-2d8f-41b6-81a4-723a5aba5fc1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:21.415440 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f204349b-2d8f-41b6-81a4-723a5aba5fc1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1568 microversion: 2.1 time: 0.150814 Aug 30 05:26:21.415999 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 580/1131] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:21 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:22.436505 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-c07daf46-fa25-48fa-badf-7d009a6e1bbb tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:22.437168 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-c07daf46-fa25-48fa-badf-7d009a6e1bbb tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:22.444852 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c07daf46-fa25-48fa-badf-7d009a6e1bbb tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:22.445327 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c07daf46-fa25-48fa-badf-7d009a6e1bbb tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:22.446331 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c07daf46-fa25-48fa-badf-7d009a6e1bbb tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:22.447054 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c07daf46-fa25-48fa-badf-7d009a6e1bbb tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:22.447515 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c07daf46-fa25-48fa-badf-7d009a6e1bbb tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:22.447942 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-c07daf46-fa25-48fa-badf-7d009a6e1bbb tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:22.453222 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff698d07-c586-4e23-8129-96262633fd1c] Reconnected to AMQP server on 10.222.0.77:5672 via [amqp] client with port 56158. Aug 30 05:26:22.577675 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-c07daf46-fa25-48fa-badf-7d009a6e1bbb tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:22.585305 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-c07daf46-fa25-48fa-badf-7d009a6e1bbb tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1568 microversion: 2.1 time: 0.152769 Aug 30 05:26:22.585874 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 552/1132] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:22 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:23.606326 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1424638a-6130-413c-b4da-f521bf465b36 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:23.606978 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1424638a-6130-413c-b4da-f521bf465b36 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:23.613448 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1424638a-6130-413c-b4da-f521bf465b36 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:23.613935 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1424638a-6130-413c-b4da-f521bf465b36 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:23.614376 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1424638a-6130-413c-b4da-f521bf465b36 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:23.615094 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1424638a-6130-413c-b4da-f521bf465b36 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:23.615554 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1424638a-6130-413c-b4da-f521bf465b36 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:23.615980 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1424638a-6130-413c-b4da-f521bf465b36 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:23.748301 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1424638a-6130-413c-b4da-f521bf465b36 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:23.756333 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1424638a-6130-413c-b4da-f521bf465b36 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1568 microversion: 2.1 time: 0.153912 Aug 30 05:26:23.756893 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 581/1133] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:23 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:24.777989 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-38273f5d-97f5-43b1-b276-aa3ded8b23f5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:24.778524 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-38273f5d-97f5-43b1-b276-aa3ded8b23f5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:24.784862 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38273f5d-97f5-43b1-b276-aa3ded8b23f5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:24.785347 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38273f5d-97f5-43b1-b276-aa3ded8b23f5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:24.785819 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38273f5d-97f5-43b1-b276-aa3ded8b23f5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:24.786514 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38273f5d-97f5-43b1-b276-aa3ded8b23f5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:24.787008 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38273f5d-97f5-43b1-b276-aa3ded8b23f5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:24.787434 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-38273f5d-97f5-43b1-b276-aa3ded8b23f5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:24.916029 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-38273f5d-97f5-43b1-b276-aa3ded8b23f5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:24.923758 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-38273f5d-97f5-43b1-b276-aa3ded8b23f5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1568 microversion: 2.1 time: 0.150418 Aug 30 05:26:24.924329 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 553/1134] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:24 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:25.944489 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-81a11e48-4cbe-4a32-b722-3b42ead95d05 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:25.945108 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-81a11e48-4cbe-4a32-b722-3b42ead95d05 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:25.951654 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81a11e48-4cbe-4a32-b722-3b42ead95d05 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:25.952132 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81a11e48-4cbe-4a32-b722-3b42ead95d05 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:25.952565 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81a11e48-4cbe-4a32-b722-3b42ead95d05 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:25.953247 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81a11e48-4cbe-4a32-b722-3b42ead95d05 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:25.953699 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81a11e48-4cbe-4a32-b722-3b42ead95d05 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:25.954122 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-81a11e48-4cbe-4a32-b722-3b42ead95d05 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:26.081646 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-81a11e48-4cbe-4a32-b722-3b42ead95d05 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:26.090090 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-81a11e48-4cbe-4a32-b722-3b42ead95d05 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1568 microversion: 2.1 time: 0.149519 Aug 30 05:26:26.090645 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 582/1135] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:25 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:27.111785 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-9d8c7ee0-b8eb-49d5-8c18-5ff1b52dc414 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:27.112407 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-9d8c7ee0-b8eb-49d5-8c18-5ff1b52dc414 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:27.118763 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d8c7ee0-b8eb-49d5-8c18-5ff1b52dc414 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:27.119287 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d8c7ee0-b8eb-49d5-8c18-5ff1b52dc414 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:27.119728 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d8c7ee0-b8eb-49d5-8c18-5ff1b52dc414 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:27.120425 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d8c7ee0-b8eb-49d5-8c18-5ff1b52dc414 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:27.120887 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d8c7ee0-b8eb-49d5-8c18-5ff1b52dc414 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:27.121347 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-9d8c7ee0-b8eb-49d5-8c18-5ff1b52dc414 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:27.253889 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-9d8c7ee0-b8eb-49d5-8c18-5ff1b52dc414 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:27.262089 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-9d8c7ee0-b8eb-49d5-8c18-5ff1b52dc414 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1568 microversion: 2.1 time: 0.154168 Aug 30 05:26:27.262695 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 554/1136] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:27 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:28.283670 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-642f539a-2462-4fd0-8935-999954c68ea1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:28.284291 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-642f539a-2462-4fd0-8935-999954c68ea1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:28.291420 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-642f539a-2462-4fd0-8935-999954c68ea1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:28.291904 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-642f539a-2462-4fd0-8935-999954c68ea1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:28.292343 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-642f539a-2462-4fd0-8935-999954c68ea1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:28.293038 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-642f539a-2462-4fd0-8935-999954c68ea1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:28.293494 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-642f539a-2462-4fd0-8935-999954c68ea1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:28.293922 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-642f539a-2462-4fd0-8935-999954c68ea1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:28.424631 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-642f539a-2462-4fd0-8935-999954c68ea1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:28.432508 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-642f539a-2462-4fd0-8935-999954c68ea1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1568 microversion: 2.1 time: 0.152677 Aug 30 05:26:28.433088 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 583/1137] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:28 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:29.453568 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-d5ffae38-c83f-44b8-bb6b-7efae7dcb61b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:29.454182 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-d5ffae38-c83f-44b8-bb6b-7efae7dcb61b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:29.460619 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5ffae38-c83f-44b8-bb6b-7efae7dcb61b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:29.461107 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5ffae38-c83f-44b8-bb6b-7efae7dcb61b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:29.461541 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5ffae38-c83f-44b8-bb6b-7efae7dcb61b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:29.462319 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5ffae38-c83f-44b8-bb6b-7efae7dcb61b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:29.462779 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5ffae38-c83f-44b8-bb6b-7efae7dcb61b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:29.463224 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-d5ffae38-c83f-44b8-bb6b-7efae7dcb61b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:29.597184 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-d5ffae38-c83f-44b8-bb6b-7efae7dcb61b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:29.605472 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-d5ffae38-c83f-44b8-bb6b-7efae7dcb61b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1568 microversion: 2.1 time: 0.155857 Aug 30 05:26:29.606043 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 555/1138] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:29 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:30.626861 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-6045b852-07d6-4580-8eb3-159fe4708825 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:30.627481 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-6045b852-07d6-4580-8eb3-159fe4708825 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:30.634061 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6045b852-07d6-4580-8eb3-159fe4708825 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:30.634544 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6045b852-07d6-4580-8eb3-159fe4708825 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:30.635012 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6045b852-07d6-4580-8eb3-159fe4708825 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:30.635700 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6045b852-07d6-4580-8eb3-159fe4708825 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:30.636147 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6045b852-07d6-4580-8eb3-159fe4708825 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:30.636566 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-6045b852-07d6-4580-8eb3-159fe4708825 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:30.767622 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-6045b852-07d6-4580-8eb3-159fe4708825 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:30.775383 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-6045b852-07d6-4580-8eb3-159fe4708825 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1568 microversion: 2.1 time: 0.152507 Aug 30 05:26:30.775957 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 584/1139] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:30 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:31.796525 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-e744fd92-eaf4-47d7-ae5d-6ebfa6f1fdd1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:31.797143 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-e744fd92-eaf4-47d7-ae5d-6ebfa6f1fdd1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:31.803653 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e744fd92-eaf4-47d7-ae5d-6ebfa6f1fdd1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:31.804140 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e744fd92-eaf4-47d7-ae5d-6ebfa6f1fdd1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:31.804579 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e744fd92-eaf4-47d7-ae5d-6ebfa6f1fdd1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:31.805888 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e744fd92-eaf4-47d7-ae5d-6ebfa6f1fdd1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:31.806352 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e744fd92-eaf4-47d7-ae5d-6ebfa6f1fdd1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:31.806777 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-e744fd92-eaf4-47d7-ae5d-6ebfa6f1fdd1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:31.934877 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-e744fd92-eaf4-47d7-ae5d-6ebfa6f1fdd1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:31.942482 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-e744fd92-eaf4-47d7-ae5d-6ebfa6f1fdd1 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1568 microversion: 2.1 time: 0.149933 Aug 30 05:26:31.943084 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 556/1140] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:31 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:32.962966 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-f7c9dc28-3efe-4405-9abd-6641b33bbe27 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:32.963878 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-f7c9dc28-3efe-4405-9abd-6641b33bbe27 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:32.969958 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7c9dc28-3efe-4405-9abd-6641b33bbe27 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:32.970440 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7c9dc28-3efe-4405-9abd-6641b33bbe27 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:32.970903 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7c9dc28-3efe-4405-9abd-6641b33bbe27 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:32.971591 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7c9dc28-3efe-4405-9abd-6641b33bbe27 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:32.972045 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7c9dc28-3efe-4405-9abd-6641b33bbe27 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:32.972466 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-f7c9dc28-3efe-4405-9abd-6641b33bbe27 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:33.105343 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-f7c9dc28-3efe-4405-9abd-6641b33bbe27 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:33.113457 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-f7c9dc28-3efe-4405-9abd-6641b33bbe27 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1568 microversion: 2.1 time: 0.154321 Aug 30 05:26:33.114027 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 585/1141] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:32 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:34.136016 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-7531465a-a7fd-4102-a71e-2b77a5b5be2f tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:34.136630 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-7531465a-a7fd-4102-a71e-2b77a5b5be2f tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:34.143016 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7531465a-a7fd-4102-a71e-2b77a5b5be2f tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:34.143505 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7531465a-a7fd-4102-a71e-2b77a5b5be2f tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:34.143942 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7531465a-a7fd-4102-a71e-2b77a5b5be2f tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:34.144630 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7531465a-a7fd-4102-a71e-2b77a5b5be2f tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:34.145087 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7531465a-a7fd-4102-a71e-2b77a5b5be2f tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:34.145511 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-7531465a-a7fd-4102-a71e-2b77a5b5be2f tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:34.280946 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-7531465a-a7fd-4102-a71e-2b77a5b5be2f tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:34.288728 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-7531465a-a7fd-4102-a71e-2b77a5b5be2f tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1509 microversion: 2.1 time: 0.157200 Aug 30 05:26:34.289289 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 557/1142] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:34 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:34.309001 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-a72ee018-387b-41fb-9cbc-67956c1e1b8a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:26:34.309616 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a72ee018-387b-41fb-9cbc-67956c1e1b8a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:34.315909 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a72ee018-387b-41fb-9cbc-67956c1e1b8a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:34.316393 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a72ee018-387b-41fb-9cbc-67956c1e1b8a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:34.316830 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a72ee018-387b-41fb-9cbc-67956c1e1b8a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:34.317515 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a72ee018-387b-41fb-9cbc-67956c1e1b8a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:34.317967 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a72ee018-387b-41fb-9cbc-67956c1e1b8a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:34.318396 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-a72ee018-387b-41fb-9cbc-67956c1e1b8a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:34.347088 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-a72ee018-387b-41fb-9cbc-67956c1e1b8a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120572) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 05:26:34.409609 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-a72ee018-387b-41fb-9cbc-67956c1e1b8a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "POST /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8/action" status: 202 len: 0 microversion: 2.1 time: 0.104783 Aug 30 05:26:34.410193 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 586/1143] 10.222.0.77 () {60 vars in 1278 bytes} [Tue Aug 30 05:26:34 2022] POST /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 05:26:34.418221 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-6bcce7be-702b-438b-903b-0979f3121271 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:34.418861 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-6bcce7be-702b-438b-903b-0979f3121271 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:34.424588 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bcce7be-702b-438b-903b-0979f3121271 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:34.425074 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bcce7be-702b-438b-903b-0979f3121271 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:34.425534 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bcce7be-702b-438b-903b-0979f3121271 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:34.426227 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bcce7be-702b-438b-903b-0979f3121271 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:34.426689 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bcce7be-702b-438b-903b-0979f3121271 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:34.427183 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-6bcce7be-702b-438b-903b-0979f3121271 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:34.588953 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-6bcce7be-702b-438b-903b-0979f3121271 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:34.596619 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-6bcce7be-702b-438b-903b-0979f3121271 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1517 microversion: 2.1 time: 0.182274 Aug 30 05:26:34.597183 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 558/1144] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:34 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:26:35.433204 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-389c3eef-00cf-4312-804a-bb1ca00ce236 req-ecf0f31f-117c-478d-aeca-8d0b3ee0bd16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc43249b-bc0f-4793-8d59-92e51dbedcd8", "name": "network-vif-unplugged", "status": "completed", "tag": "28cd9f07-60ec-4528-9911-a8bd30f4567a"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:26:35.444572 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-389c3eef-00cf-4312-804a-bb1ca00ce236 req-ecf0f31f-117c-478d-aeca-8d0b3ee0bd16 service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:35.445090 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-389c3eef-00cf-4312-804a-bb1ca00ce236 req-ecf0f31f-117c-478d-aeca-8d0b3ee0bd16 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:35.446028 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-389c3eef-00cf-4312-804a-bb1ca00ce236 req-ecf0f31f-117c-478d-aeca-8d0b3ee0bd16 service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:35.457996 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.compute.server_external_events [req-389c3eef-00cf-4312-804a-bb1ca00ce236 req-ecf0f31f-117c-478d-aeca-8d0b3ee0bd16 service nova] Unable to find a host for instance cc43249b-bc0f-4793-8d59-92e51dbedcd8. Dropping event network-vif-unplugged {{(pid=120572) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 05:26:35.458923 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-389c3eef-00cf-4312-804a-bb1ca00ce236 req-ecf0f31f-117c-478d-aeca-8d0b3ee0bd16 service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030396 Aug 30 05:26:35.459623 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 587/1145] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 05:26:35.618098 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-dba7224e-bd54-49f4-97b3-5f7cd6c5055b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:35.618760 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-dba7224e-bd54-49f4-97b3-5f7cd6c5055b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:35.624984 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dba7224e-bd54-49f4-97b3-5f7cd6c5055b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:35.625478 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dba7224e-bd54-49f4-97b3-5f7cd6c5055b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:35.625924 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dba7224e-bd54-49f4-97b3-5f7cd6c5055b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:35.626626 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dba7224e-bd54-49f4-97b3-5f7cd6c5055b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:35.627116 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dba7224e-bd54-49f4-97b3-5f7cd6c5055b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:35.627549 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-dba7224e-bd54-49f4-97b3-5f7cd6c5055b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:35.761342 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-dba7224e-bd54-49f4-97b3-5f7cd6c5055b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:35.768994 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-dba7224e-bd54-49f4-97b3-5f7cd6c5055b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1517 microversion: 2.1 time: 0.155349 Aug 30 05:26:35.769547 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 559/1146] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:35 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:36.789381 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-57f1e578-34f7-4610-8dc8-85c63ddf00e5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:36.789994 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-57f1e578-34f7-4610-8dc8-85c63ddf00e5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:36.796333 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57f1e578-34f7-4610-8dc8-85c63ddf00e5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:36.796852 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57f1e578-34f7-4610-8dc8-85c63ddf00e5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:36.797256 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57f1e578-34f7-4610-8dc8-85c63ddf00e5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:36.797891 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57f1e578-34f7-4610-8dc8-85c63ddf00e5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:36.798424 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57f1e578-34f7-4610-8dc8-85c63ddf00e5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:36.798746 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-57f1e578-34f7-4610-8dc8-85c63ddf00e5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:36.929926 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-57f1e578-34f7-4610-8dc8-85c63ddf00e5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:36.937567 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-57f1e578-34f7-4610-8dc8-85c63ddf00e5 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1517 microversion: 2.1 time: 0.152121 Aug 30 05:26:36.938127 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 588/1147] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:36 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:37.958521 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-78ba7d61-ae0b-4470-b9f5-8f4c4402a31a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:37.959197 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-78ba7d61-ae0b-4470-b9f5-8f4c4402a31a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:37.966192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78ba7d61-ae0b-4470-b9f5-8f4c4402a31a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:37.966675 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78ba7d61-ae0b-4470-b9f5-8f4c4402a31a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:37.967129 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78ba7d61-ae0b-4470-b9f5-8f4c4402a31a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:37.967813 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78ba7d61-ae0b-4470-b9f5-8f4c4402a31a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:37.968267 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78ba7d61-ae0b-4470-b9f5-8f4c4402a31a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:37.968692 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-78ba7d61-ae0b-4470-b9f5-8f4c4402a31a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:38.096012 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-78ba7d61-ae0b-4470-b9f5-8f4c4402a31a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:38.104300 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-78ba7d61-ae0b-4470-b9f5-8f4c4402a31a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1517 microversion: 2.1 time: 0.149677 Aug 30 05:26:38.104861 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 560/1148] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:37 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:39.124977 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-cfe58b20-c163-4cab-8911-6d41d154ab92 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:39.125618 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-cfe58b20-c163-4cab-8911-6d41d154ab92 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:39.131972 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfe58b20-c163-4cab-8911-6d41d154ab92 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:39.132449 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfe58b20-c163-4cab-8911-6d41d154ab92 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:39.132877 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfe58b20-c163-4cab-8911-6d41d154ab92 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:39.133591 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfe58b20-c163-4cab-8911-6d41d154ab92 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:39.134040 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfe58b20-c163-4cab-8911-6d41d154ab92 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:39.134461 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-cfe58b20-c163-4cab-8911-6d41d154ab92 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:39.265409 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-cfe58b20-c163-4cab-8911-6d41d154ab92 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:39.273033 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-cfe58b20-c163-4cab-8911-6d41d154ab92 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1519 microversion: 2.1 time: 0.151867 Aug 30 05:26:39.273590 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 589/1149] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:39 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:40.293693 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-1089c233-ed9d-4bf2-87e5-d42df132674b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:40.294346 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-1089c233-ed9d-4bf2-87e5-d42df132674b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:40.300797 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1089c233-ed9d-4bf2-87e5-d42df132674b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:40.301290 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1089c233-ed9d-4bf2-87e5-d42df132674b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:40.301727 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1089c233-ed9d-4bf2-87e5-d42df132674b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:40.302461 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1089c233-ed9d-4bf2-87e5-d42df132674b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:40.302993 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1089c233-ed9d-4bf2-87e5-d42df132674b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:40.303424 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-1089c233-ed9d-4bf2-87e5-d42df132674b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:40.491852 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-1089c233-ed9d-4bf2-87e5-d42df132674b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:40.500157 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-1089c233-ed9d-4bf2-87e5-d42df132674b tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1575 microversion: 2.1 time: 0.210439 Aug 30 05:26:40.500736 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 561/1150] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:40 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1575 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:26:41.520632 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-c6b0cb2d-be7b-43e6-ab27-c549e2582fec tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:41.521274 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-c6b0cb2d-be7b-43e6-ab27-c549e2582fec tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:41.528405 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6b0cb2d-be7b-43e6-ab27-c549e2582fec tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:41.528881 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6b0cb2d-be7b-43e6-ab27-c549e2582fec tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:41.529319 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6b0cb2d-be7b-43e6-ab27-c549e2582fec tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:41.529998 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6b0cb2d-be7b-43e6-ab27-c549e2582fec tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:41.530455 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6b0cb2d-be7b-43e6-ab27-c549e2582fec tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:41.530886 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-c6b0cb2d-be7b-43e6-ab27-c549e2582fec tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:41.661075 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-c6b0cb2d-be7b-43e6-ab27-c549e2582fec tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:41.668722 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-c6b0cb2d-be7b-43e6-ab27-c549e2582fec tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1575 microversion: 2.1 time: 0.151958 Aug 30 05:26:41.669281 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 590/1151] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:41 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:42.689573 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-263b2186-24e5-4105-9a49-536f8f8def80 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:42.690217 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-263b2186-24e5-4105-9a49-536f8f8def80 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:42.696757 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-263b2186-24e5-4105-9a49-536f8f8def80 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:42.697250 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-263b2186-24e5-4105-9a49-536f8f8def80 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:42.697690 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-263b2186-24e5-4105-9a49-536f8f8def80 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:42.698388 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-263b2186-24e5-4105-9a49-536f8f8def80 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:42.698874 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-263b2186-24e5-4105-9a49-536f8f8def80 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:42.699306 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-263b2186-24e5-4105-9a49-536f8f8def80 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:42.830987 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-263b2186-24e5-4105-9a49-536f8f8def80 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:42.839542 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-263b2186-24e5-4105-9a49-536f8f8def80 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1575 microversion: 2.1 time: 0.153891 Aug 30 05:26:42.840115 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 562/1152] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:42 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:26:43.859842 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-1e89c998-7b1f-425c-80e0-2a7fa70ff6db tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:43.860456 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-1e89c998-7b1f-425c-80e0-2a7fa70ff6db tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:43.866964 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e89c998-7b1f-425c-80e0-2a7fa70ff6db tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:43.867458 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e89c998-7b1f-425c-80e0-2a7fa70ff6db tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:43.867945 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e89c998-7b1f-425c-80e0-2a7fa70ff6db tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:43.868633 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e89c998-7b1f-425c-80e0-2a7fa70ff6db tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:43.869084 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e89c998-7b1f-425c-80e0-2a7fa70ff6db tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:43.869508 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-1e89c998-7b1f-425c-80e0-2a7fa70ff6db tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:44.001215 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-1e89c998-7b1f-425c-80e0-2a7fa70ff6db tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:44.008870 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-1e89c998-7b1f-425c-80e0-2a7fa70ff6db tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1575 microversion: 2.1 time: 0.152868 Aug 30 05:26:44.009437 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 591/1153] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:43 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:45.030056 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-adc22285-acaa-41e9-960f-e5fc8bc12d35 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:45.030676 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-adc22285-acaa-41e9-960f-e5fc8bc12d35 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:45.037069 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-adc22285-acaa-41e9-960f-e5fc8bc12d35 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:45.037554 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-adc22285-acaa-41e9-960f-e5fc8bc12d35 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:45.037992 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-adc22285-acaa-41e9-960f-e5fc8bc12d35 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:45.038716 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-adc22285-acaa-41e9-960f-e5fc8bc12d35 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:45.039197 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-adc22285-acaa-41e9-960f-e5fc8bc12d35 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:45.040128 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-adc22285-acaa-41e9-960f-e5fc8bc12d35 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:45.165192 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-adc22285-acaa-41e9-960f-e5fc8bc12d35 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:45.172770 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-adc22285-acaa-41e9-960f-e5fc8bc12d35 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1575 microversion: 2.1 time: 0.146553 Aug 30 05:26:45.173342 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 563/1154] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:45 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:45.576164 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-6c737819-fce2-4799-ae18-78b35370f95b req-20ad3d84-c023-441d-884c-77331808f54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc43249b-bc0f-4793-8d59-92e51dbedcd8", "name": "network-vif-plugged", "status": "completed", "tag": "28cd9f07-60ec-4528-9911-a8bd30f4567a"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:26:45.587844 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-6c737819-fce2-4799-ae18-78b35370f95b req-20ad3d84-c023-441d-884c-77331808f54e service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:45.588627 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-6c737819-fce2-4799-ae18-78b35370f95b req-20ad3d84-c023-441d-884c-77331808f54e service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:45.589354 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-6c737819-fce2-4799-ae18-78b35370f95b req-20ad3d84-c023-441d-884c-77331808f54e service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:45.600638 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-6c737819-fce2-4799-ae18-78b35370f95b req-20ad3d84-c023-441d-884c-77331808f54e service nova] Creating event network-vif-plugged:28cd9f07-60ec-4528-9911-a8bd30f4567a for instance cc43249b-bc0f-4793-8d59-92e51dbedcd8 on hv-cinder-85391 Aug 30 05:26:45.606708 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-6c737819-fce2-4799-ae18-78b35370f95b req-20ad3d84-c023-441d-884c-77331808f54e service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034154 Aug 30 05:26:45.607520 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 592/1155] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:26:46.193502 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-ecf16159-9e94-48b8-9735-156fe08fffb4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:46.194109 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-ecf16159-9e94-48b8-9735-156fe08fffb4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:46.201119 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecf16159-9e94-48b8-9735-156fe08fffb4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:46.201605 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecf16159-9e94-48b8-9735-156fe08fffb4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:46.202044 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecf16159-9e94-48b8-9735-156fe08fffb4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:46.202736 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecf16159-9e94-48b8-9735-156fe08fffb4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:46.203218 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecf16159-9e94-48b8-9735-156fe08fffb4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:46.203647 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-ecf16159-9e94-48b8-9735-156fe08fffb4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:46.332042 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-ecf16159-9e94-48b8-9735-156fe08fffb4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:46.339984 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-ecf16159-9e94-48b8-9735-156fe08fffb4 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1575 microversion: 2.1 time: 0.150414 Aug 30 05:26:46.340559 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 564/1156] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:46 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:47.361095 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-eb3daa4b-9430-4869-8b90-3faf61536008 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:47.361796 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-eb3daa4b-9430-4869-8b90-3faf61536008 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:47.368377 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb3daa4b-9430-4869-8b90-3faf61536008 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:47.368863 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb3daa4b-9430-4869-8b90-3faf61536008 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:47.369875 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb3daa4b-9430-4869-8b90-3faf61536008 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:47.370708 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb3daa4b-9430-4869-8b90-3faf61536008 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:47.371216 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb3daa4b-9430-4869-8b90-3faf61536008 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:47.371647 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-eb3daa4b-9430-4869-8b90-3faf61536008 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:47.505857 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-eb3daa4b-9430-4869-8b90-3faf61536008 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:47.509466 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:47.514611 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-eb3daa4b-9430-4869-8b90-3faf61536008 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1562 microversion: 2.1 time: 0.157824 Aug 30 05:26:47.515208 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 593/1157] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:47 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1562 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:01.656682 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_api:SELECT=28 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:01.657454 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG dbcounter [-] [120573] Writing DB stats nova_cell1:SELECT=84 {{(pid=120573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:01.658658 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:28:01.659083 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Tue Aug 30 05:28:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 (ip 10.222.0.77) !!! Aug 30 05:28:01.660076 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:28:01.660400 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: Tue Aug 30 05:28:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 (ip 10.222.0.77) !!! Aug 30 05:28:01.661468 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG dbcounter [-] [120572] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:01.666810 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-4993cb10-642f-43e7-9546-bb41abd91044 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:01.667353 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4993cb10-642f-43e7-9546-bb41abd91044 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:01.681362 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4993cb10-642f-43e7-9546-bb41abd91044 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:01.682166 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4993cb10-642f-43e7-9546-bb41abd91044 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:01.682857 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4993cb10-642f-43e7-9546-bb41abd91044 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:01.683818 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4993cb10-642f-43e7-9546-bb41abd91044 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:01.684413 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4993cb10-642f-43e7-9546-bb41abd91044 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:01.684858 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-4993cb10-642f-43e7-9546-bb41abd91044 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:01.711952 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-4993cb10-642f-43e7-9546-bb41abd91044 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Going to try to terminate instance {{(pid=120573) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:28:01.729783 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-e5042d80-47b2-46be-80d4-b4ebe8b67d2c req-59f0046f-bb62-4815-9b11-4187ae42291c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc43249b-bc0f-4793-8d59-92e51dbedcd8", "tag": "28cd9f07-60ec-4528-9911-a8bd30f4567a"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:28:01.739137 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e5042d80-47b2-46be-80d4-b4ebe8b67d2c req-59f0046f-bb62-4815-9b11-4187ae42291c service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:01.739925 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e5042d80-47b2-46be-80d4-b4ebe8b67d2c req-59f0046f-bb62-4815-9b11-4187ae42291c service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:01.740359 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e5042d80-47b2-46be-80d4-b4ebe8b67d2c req-59f0046f-bb62-4815-9b11-4187ae42291c service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:01.752911 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-e5042d80-47b2-46be-80d4-b4ebe8b67d2c req-59f0046f-bb62-4815-9b11-4187ae42291c service nova] Creating event network-changed:28cd9f07-60ec-4528-9911-a8bd30f4567a for instance cc43249b-bc0f-4793-8d59-92e51dbedcd8 on hv-cinder-85391 Aug 30 05:28:01.758003 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-e5042d80-47b2-46be-80d4-b4ebe8b67d2c req-59f0046f-bb62-4815-9b11-4187ae42291c service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099981 Aug 30 05:28:01.758591 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 594/1158] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:28:01.798947 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-4993cb10-642f-43e7-9546-bb41abd91044 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "DELETE /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 204 len: 0 microversion: 2.1 time: 0.143687 Aug 30 05:28:01.799553 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 565/1159] 10.222.0.77 () {58 vars in 1239 bytes} [Tue Aug 30 05:28:01 2022] DELETE /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:28:01.810024 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-b749a071-a3f5-40e7-a73a-58db5c95034d tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:01.811946 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-b749a071-a3f5-40e7-a73a-58db5c95034d tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:01.818523 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b749a071-a3f5-40e7-a73a-58db5c95034d tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:01.819119 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b749a071-a3f5-40e7-a73a-58db5c95034d tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:01.819555 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b749a071-a3f5-40e7-a73a-58db5c95034d tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:01.820435 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b749a071-a3f5-40e7-a73a-58db5c95034d tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:01.821072 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b749a071-a3f5-40e7-a73a-58db5c95034d tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:01.821495 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-b749a071-a3f5-40e7-a73a-58db5c95034d tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:02.002654 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.policy [None req-b749a071-a3f5-40e7-a73a-58db5c95034d tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120572) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:02.010444 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-b749a071-a3f5-40e7-a73a-58db5c95034d tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1568 microversion: 2.1 time: 0.205528 Aug 30 05:28:02.011112 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 595/1160] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:01 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:03.033711 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-76ed65b6-417a-4ebf-bd70-f6b6d2f7599a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:03.034411 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-76ed65b6-417a-4ebf-bd70-f6b6d2f7599a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:03.040928 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76ed65b6-417a-4ebf-bd70-f6b6d2f7599a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:03.041414 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76ed65b6-417a-4ebf-bd70-f6b6d2f7599a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:03.042119 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76ed65b6-417a-4ebf-bd70-f6b6d2f7599a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:03.042629 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76ed65b6-417a-4ebf-bd70-f6b6d2f7599a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:03.043108 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76ed65b6-417a-4ebf-bd70-f6b6d2f7599a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:03.043555 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-76ed65b6-417a-4ebf-bd70-f6b6d2f7599a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:03.260148 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-76ed65b6-417a-4ebf-bd70-f6b6d2f7599a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:03.268903 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-76ed65b6-417a-4ebf-bd70-f6b6d2f7599a tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1568 microversion: 2.1 time: 0.239398 Aug 30 05:28:03.269483 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 566/1161] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:03 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:04.112717 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [req-e55dc4f5-e2b0-4222-8f0b-16e4e6ca8831 req-2fbce5ad-fa1e-4769-8a43-8932aeb0f96f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc43249b-bc0f-4793-8d59-92e51dbedcd8", "name": "network-vif-deleted", "tag": "28cd9f07-60ec-4528-9911-a8bd30f4567a"}]} {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:28:04.121890 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e55dc4f5-e2b0-4222-8f0b-16e4e6ca8831 req-2fbce5ad-fa1e-4769-8a43-8932aeb0f96f service nova] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:04.122395 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e55dc4f5-e2b0-4222-8f0b-16e4e6ca8831 req-2fbce5ad-fa1e-4769-8a43-8932aeb0f96f service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:04.122847 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [req-e55dc4f5-e2b0-4222-8f0b-16e4e6ca8831 req-2fbce5ad-fa1e-4769-8a43-8932aeb0f96f service nova] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:04.133399 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.compute.server_external_events [req-e55dc4f5-e2b0-4222-8f0b-16e4e6ca8831 req-2fbce5ad-fa1e-4769-8a43-8932aeb0f96f service nova] Creating event network-vif-deleted:28cd9f07-60ec-4528-9911-a8bd30f4567a for instance cc43249b-bc0f-4793-8d59-92e51dbedcd8 on hv-cinder-85391 Aug 30 05:28:04.138286 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [req-e55dc4f5-e2b0-4222-8f0b-16e4e6ca8831 req-2fbce5ad-fa1e-4769-8a43-8932aeb0f96f service nova] 10.222.0.77 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085054 Aug 30 05:28:04.138876 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 596/1162] 10.222.0.77 () {64 vars in 1317 bytes} [Tue Aug 30 05:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:28:04.289630 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-58112e74-3b3f-433a-9067-0e80a9da8d09 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:04.290157 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.compute.api [None req-58112e74-3b3f-433a-9067-0e80a9da8d09 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120573) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:04.297095 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58112e74-3b3f-433a-9067-0e80a9da8d09 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:04.297578 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58112e74-3b3f-433a-9067-0e80a9da8d09 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:04.298011 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58112e74-3b3f-433a-9067-0e80a9da8d09 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:04.298699 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58112e74-3b3f-433a-9067-0e80a9da8d09 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:04.299184 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58112e74-3b3f-433a-9067-0e80a9da8d09 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:04.299619 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG oslo_concurrency.lockutils [None req-58112e74-3b3f-433a-9067-0e80a9da8d09 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120573) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:04.362622 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.policy [None req-58112e74-3b3f-433a-9067-0e80a9da8d09 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9b73d97e8145a39215f179b1398350', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05ebb49967334f8bb6f2077fce987ee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120573) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:04.370462 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-58112e74-3b3f-433a-9067-0e80a9da8d09 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 200 len: 1219 microversion: 2.1 time: 0.084818 Aug 30 05:28:04.371068 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 567/1163] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:04 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:05.391551 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-37263659-76b0-4e8b-aea3-3cc5da7e717c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '>' {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:05.392255 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.compute.api [None req-37263659-76b0-4e8b-aea3-3cc5da7e717c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] [instance: cc43249b-bc0f-4793-8d59-92e51dbedcd8] Fetching instance by UUID {{(pid=120572) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:05.398423 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37263659-76b0-4e8b-aea3-3cc5da7e717c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:05.398950 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37263659-76b0-4e8b-aea3-3cc5da7e717c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:05.399393 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37263659-76b0-4e8b-aea3-3cc5da7e717c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:05.400083 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37263659-76b0-4e8b-aea3-3cc5da7e717c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Acquiring lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:05.400540 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37263659-76b0-4e8b-aea3-3cc5da7e717c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:05.400969 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG oslo_concurrency.lockutils [None req-37263659-76b0-4e8b-aea3-3cc5da7e717c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Lock "f3c89321-9723-4736-ac96-a4b564d2d0f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:05.413998 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.wsgi [None req-37263659-76b0-4e8b-aea3-3cc5da7e717c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] HTTP exception thrown: Instance cc43249b-bc0f-4793-8d59-92e51dbedcd8 could not be found. Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-37263659-76b0-4e8b-aea3-3cc5da7e717c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Request method failure captured: Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: request: GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 HTTP/1.1 Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept: application/json Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Accept-Encoding: identity Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Connection: close Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Length: 0 Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Content-Type: application/json Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Host: 10.222.0.77 Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: Openstack-System-Scope: None Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: User-Agent: python-urllib3/1.26.12 Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Auth-Token: gAAAAABjDZ7dGRy179GGvf_Pp2SD0Oztcxi5UrFZhNEhmFaLU8r9re22IGq91y7LMceYcBz_sHsqlC_BMgyUGTLhtEEdKtRoNV9Bz6sJuPvUAgMtcHG8nPLGs81Eqx-se5FByAnV99GtSRAPU_VgF8YrUlXkQ1gjn0fiGh7eme4sXuMX-TQ8mhs Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Id: None Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Domain-Name: None Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Identity-Status: Confirmed Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Is-Admin-Project: True Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Id: default Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Domain-Name: Default Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Id: 05ebb49967334f8bb6f2077fce987ee3 Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Project-Name: tempest-TestShelveInstance-1901875317 Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Role: reader,member Aug 30 05:28:05.415661 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Roles: reader,member Aug 30 05:28:05.417473 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/05ebb49967334f8bb6f2077fce987ee3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/compute/v2/05ebb49967334f8bb6f2077fce987ee3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/volume/v3/05ebb49967334f8bb6f2077fce987ee3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.77:8080/v1/AUTH_05ebb49967334f8bb6f2077fce987ee3", "adminURL": "http://10.222.0.77:8080"}]}] Aug 30 05:28:05.417473 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant: tempest-TestShelveInstance-1901875317 Aug 30 05:28:05.417473 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Id: 05ebb49967334f8bb6f2077fce987ee3 Aug 30 05:28:05.417473 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-Tenant-Name: tempest-TestShelveInstance-1901875317 Aug 30 05:28:05.417473 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User: tempest-TestShelveInstance-1901875317-project Aug 30 05:28:05.417473 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Id: default Aug 30 05:28:05.417473 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Domain-Name: Default Aug 30 05:28:05.417473 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Id: 8f9b73d97e8145a39215f179b1398350 Aug 30 05:28:05.417473 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: X-User-Name: tempest-TestShelveInstance-1901875317-project Aug 30 05:28:05.417473 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: method: > Aug 30 05:28:05.417473 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: exception: Instance cc43249b-bc0f-4793-8d59-92e51dbedcd8 could not be found. Aug 30 05:28:05.417473 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: action_args: {'id': 'cc43249b-bc0f-4793-8d59-92e51dbedcd8'} Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: {{(pid=120572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc43249b-bc0f-4793-8d59-92e51dbedcd8 could not be found. Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:28:05.418765 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc43249b-bc0f-4793-8d59-92e51dbedcd8 could not be found. Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc43249b-bc0f-4793-8d59-92e51dbedcd8 could not be found. Aug 30 05:28:05.421052 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: ERROR nova.api.openstack.wsgi Aug 30 05:28:05.422749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: DEBUG nova.api.openstack.wsgi [None req-37263659-76b0-4e8b-aea3-3cc5da7e717c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Returning 404 to user: Instance cc43249b-bc0f-4793-8d59-92e51dbedcd8 could not be found. {{(pid=120572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:28:05.422749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: INFO nova.api.openstack.requestlog [None req-37263659-76b0-4e8b-aea3-3cc5da7e717c tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8" status: 404 len: 111 microversion: 2.1 time: 0.030224 Aug 30 05:28:05.422749 dv-cinder-853910-4-iscsi devstack@n-api.service[120572]: [pid: 120572|app: 0|req: 597/1164] 10.222.0.77 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:05 2022] GET /compute/v2.1/servers/cc43249b-bc0f-4793-8d59-92e51dbedcd8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:28:05.574542 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: DEBUG nova.api.openstack.wsgi [None req-b33e6800-17fe-4d90-99d5-98de4f3b7b44 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] Calling method '.version_select at 0x7f822ebf8310>' {{(pid=120573) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:05.597427 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: INFO nova.api.openstack.requestlog [None req-b33e6800-17fe-4d90-99d5-98de4f3b7b44 tempest-TestShelveInstance-1901875317 tempest-TestShelveInstance-1901875317-project] 10.222.0.77 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-823395391" status: 202 len: 0 microversion: 2.1 time: 0.026712 Aug 30 05:28:05.598016 dv-cinder-853910-4-iscsi devstack@n-api.service[120573]: [pid: 120573|app: 0|req: 568/1165] 10.222.0.77 () {58 vars in 1251 bytes} [Tue Aug 30 05:28:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-823395391 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)